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(57) Abstract 

This invention relates to a system and method for interactive, adaptive, and individualized computer assisted instruction. This invention 
includes an agent (108) for each student (101) which adapts to its student, and provides individualized guidance to the student and controls 
to the augmented computer assisted instructional materials. The instructional materials of this invention are augmented to communicate 
the student's performance and the material's pedagogical characteristics to the agent, and to receive control from the agent. In a preferred 
embodiment, the agent maintains data reflecting the student's pedagogic or cognitive characteristics in a protected and portable media in 
the personal control of the student. Preferably, the content of the communication between the agent and the materials conforms to specified 
interface standards, so that the agent acts independently of the content of the particular materials. Also preferably, the agent can project 
using various I/O modalities integrated engaging, lifelike display personna(e). 
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AGENT BASED INSTRUCTION 
SYSTEM AND METHOD 



1. FIELD OF THE INVENTION 

5 This invention relates to a system and method for 

interactive, adaptive, and individualized computer-assisted 
instruction of students, preferably implemented on network 
connected computers. More particularly the system and method 
includes for each student an agent adapted to that student 

10 which monitors its student's instructional behavior, responds 
to teacher direction, and controls the instructional 
progress, and guides its student, all of which constitute one 
aspect of a virtual tutor. Preferably, the viewable on- 
screen aspect of the agent includes customizable multimedia 

15 presentation personae, which constitute a further aspect of a 
virtual tutor. 

2. BACKGROUND OF THE INVENTION 

The application of computers in education has been 

20 limited by several problems, including a failure to provide 
systems that adapt or individualize to each student, a 
failure to integrate systems effectively into the existing 
classroom in elementary and secondary schools, and a failure 
to exploit technological developments. Although during the 

25 last three decades, a number of interactive educational 
techniques have been implemented on computers, all these 
systems lack the ability to recognize and to adapt to each 
student's individual characteristics. The common motivation 
for interactive educational techniques was the recognition 

30 that individual student interaction fosters learning to a 
greater degree than mere passive exposure to a fixed pace 
presentation (Kulik et al., 1986, Effectiveness of computer- 
based adult learning: a meta-analysis, Journal of educational 
computing research 2:235-252; Kulik et al., 1983, Effects of 

35 computer-based teaching on secondary school students, Journal 
of educational psychology 75:19-26). Existing, interactive 
educational techniques have many variants: programmed 
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instruction, mastery learning, audio-tutorials, direct 
instruction, personalized system of instruction, precision 
teaching, fluency learning and others (Engleman et al i 982 
Theory of instruction: Principles and Applications 
5 irvington. New York; Keller, 1968, "Goodbye, teacher » 
Journal of A ppi ied Benavior u ' ' 

Precision teaching: By teachers for children, Teaching 
Exceptional Children 21:353-359; West et al., 199 2, Designs 
for Excellence in Education: the Legacy of B.F. skinner 
10 sorris west, inc., Longmont, Colorado, pp. 147 -160) . several 
systems have attempted to harness the interactivity of the 
computer for these interactive educational techniques, m 
early work, for example, text-based programmed instruction 
was converted to computer format and implemented on time- 
15 shared systems. This early development was extended with 
more sophisticated computer-assisted instruction ("CAI") , 
also known as compute based training ("CBT") . 

In CAI, for example, the computer acts as a teaching 
machine. A program presents instructional displays, accepts 

?! n Y eSPOnSeS ' SditS jUd9eS th ° Se responses, branches 
on the basis of student responses, gives feedback to the 
student, and records and stores the student's progress 
Examples of CAI systems include those of Carbonell, 1970 Al 
in CAI, an artificial intelligence approach to computer-' 
25 assisted instruction, X OE Transactions on Man-machine 
Systems, 11:190-202; Osin, 1984, CAI on a national scale 
Proc. 4th Jerusalem Conf. on Information Technology, pp 418- 
424; seidel 1971; Koffman et al., 1975, Artificial 
intelligence and artificial programming in CAI, Artificial 
30 intelligence 6.:2l5-234. Effective CAI instructional 

materials for a limited number of specific topics have been 
developed, as have special "authoring languages," which 
assist instructional developers on the tasks of designing 
instructional materials, o.s. Patent No. 5,310,349 is 
35 exemplary of such CAI systems. 

However, existing CAI systems do not adapt to thei- 
students. These systems merely sequence students through 
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educational materials, based only on student performance 
during a current lesson and using only parameters such as 
recent responses and pre-requisite patterns. These systems 
do not gather or use information on more comprehensive 
5 student characteristics, such as past student performance, 
student performance on other courses, student learning 
styles, and student interests. 

A greater deficiency is that existing CAI systems do not 
recognize characteristics of their individual students. They 
10 cannot be individualized or made responsive to their students 
styles. Thereby, these system ignore those roles of a human 
tutor that can be of unparalleled significance in the 
education of an individual. The human tutor assists in 
scheduling and prioritizing and in maintaining interest 
15 through proper reinforcement and knowledge of student 
abilities and preferences. A human tutor observes and 
addresses patterns of errors and maintains a consistent 
manner of interaction across a broad range of subject matters 
and activities. Moreover, a human tutor effectively 
20 integrates the cognitive, personal and social aspects of the 
instructional situation. In other words the human tutor 
provides a level of individualization based on student styles 
and on requirements of the instructional task. Furthermore, 
the human tutor provides an equally effective interaction 
25 with the teacher by accepting individualized instructions, 
collecting data and providing detailed reports. By failing 
to address these higher order services and roles of an 
effective human tutor, existing CAI systems fail to fully 
engage their students and thus fail instruct as well as 
30 possible. 

Additionally, a further problem of computer assisted 
instruction, particularly in primary and secondary school 
settings is poor integration into the rest of the school 
curriculum and often poor quality of the educational 
35 materials. In application to elementary and secondary 
schools, two main patterns of instructional computer use 
prevail, which illustrate the compromises prevalent today. 
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in o„ e pattern , the integrated learning ^ 

a^To d f inSt : llati ° n that 13 ^ ^ SCh ° 0lS * tJh basic 
strands of reading, mathematics and related topics spellina 
writing, and other language arts , froa ^ ^ ^ ^' 
5 perhaps to eight or nine (EPIE, 1990, Xntearated 

instructional Systems: an Evaluation, Educational Products 
information Exchange, Hampton Bays, ».„.,. The paradoj£ 
th,s pattern, regardless of the quality of the instruction 

10 LIT" * th6Se SySt6aS ' ^ VOVk ° f StUdents in bears 
10 ixttle relation to what goes on in the classrooms in that 

very same topic. The fundamental reason is that the teacher 

cannot influence or respond meaningfully to variations in 

Ind 2 T 9 " 83 " ^ relati ° nS betWee " th * CAI curriculum 
and the classroom text, materials and activities. This is 

15 the case even where the ILS installation produces reports in 

some detail as to each student's progress and standing 

standi ""T Patt6rn ° f C ° BPUter ln SCh0 ° ls is ^at of 
Stand-alone short units on specific topics <tess, 1996 

Database of Educational Software Systems, Educational ' 

20 Products Information Exchange, Hampton Bays, N.Y.). These 

can be hypercard programs, simulations, or games, and are 

usually separate from the basic classroom curriculum. Though 

occasionally of excellent quality, the paradox here is that 

these products are usually chosen for enhancement, possible 

25 optional, and do not account for a major component of school 

related instruction. No records are kept or returned 

regarding student performance. These programs have not made 

a major contribution to school instruction. 

Finally, computer assisted instruction systems have 

30 ignored or under utilized such important developments in 

computer technology over the past four years as agent-based 

system, client-server systems, and networking systems 

Though now an active field with a wide spectrum of activities 

from research to commercial applications, application of 

35 agent-based systems in educational, instructional, and 

homework tasks has not been explored, software systems for 

intelligent agents have successfully applied in travel 
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arrangements, email management, meeting scheduling, stock 
portfolio management, and gathering information from the 
Internet (Maes, 1994, Agents that reduce work and information 
overload, Communications of the ACM 22:30-40). in all these 
5 applications, software agents perform tasks on the user's 
behalf, receiving only general instructions from their user 
but then executing detailed tasks with considerable 
independence and initiative. In client-server systems, these 
agents can operate in the client, the server, or both. 

10 Recently, adaptive and personalized agent based systems 

have begun to be developed. Systems with adaptive agents, 
agents which learn from experience, has made gains with new 
techniques continually identified. Adaptive agents have 
permitted new commercially viable adaptive systems 

15 implemented across networks. In these systems, an agent is a 
"go-between, " mediating relations in a manner whose function 
is understood with details being left to the agent itself. 
The agent acts as a "stand-in" for its user, who is thus 
freed from direct manipulation of the network. In 

20 instructional applications, there is an unmet need for an 
agent who serves two users: the school system and the 
individual student. This is the well-known role of the 
teaching assistant/ tutor . Maes, 1994, and others have 
extended the metaphor of agent to that of personal assistant, 

25 an agent who learns some important characteristics of its 
user, and adapts its behavior accordingly. Agents can learn 
by a mixture of methods: observation, receiving feedback 
from its user, receiving instructions from the user, and 
consulting other agents concerning "similar problems." To 

30 combine the important properties of competence, trust, and 
intimacy that a personal assistant should have, an agent 
should be in touch with relevant data, represent important 
facts in a reliable manner, and engage with its user in a 
personal and fundamentally sympathetic — at times playful — 

35 manner. Approaches to the creation of agents with personal 
characteristics have begun to be explored. In this work, 
relevant techniques are found in the tradition of film 
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abators who, through the portrayal of emotions, gave their 
characters the illusion of life. 

Moreover, computer assisted instructional systems have 
only haphazardly exploited the potential of client-server 
5 systems and networking technologies. Client-server 

architectures have emerged as the principal architecture of 
debuted computer systems, client systems, running under 
sophisticated windowing operating systems, can support 
advanced object based software applications, including hi g h 
10 speed graphics, animation and audio output. Servers can 
store gigabytes of data and programs at central or 
distributed locations at quite reasonable cost, object 
oriented database systems have been developed to store 
structured data on servers. 
» Client systems, in a striking change from only several 

years ago, now virtually all have multimedia capabilities 
including high quality graphics, sound, and at least limited 
video playback capability. Text-to-speech software is 
presently available for use with these systems, and speech 
20 recognition software is on brin* of widespread commercial 
acceptability on low cost platforms. Ne „ authoring tools 
support graphical methods for generation of multimedia 
presentations and computer based instructional materials 
having corresponding sequencing logic. 
25 Clients and servers can be linked remotely with 

increasing convenience and decreasing cost. The Internet has 
emerged as a means of providing an inexpensive means of 
connecting computers to provide effective communications and 
access to information and other resources such as software 
30 Further Internet developments that made the Internet truly' 
universal include the HTML and the HTTP protocols, which 
provide platform independent access to hyperlinked multimedia 
information, and the Java- programming language, which 
provides platform independent software for Internet 
35 applications programming. Subsets of the Internet — 

intranets ~ have become an increasingly important means *or 
disseminating information and enabling -communication within 
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constrained domains, such as a single school system or 
corporate enterprise. 

Existing CAI systems have not addressed these functional 
deficiencies nor have they exploited the possibilities of 
5 existing technologies. 

Citation of references hereinabove shall not be 
construed as an admission that such a reference is prior "art 
to the present invention. 

1° 3. SUMMARY OF THg INVENTION 

The Agent Based Instruction ("ABI") system of this 
invention is a system and method for interactive, adaptive, 
and individualized computer-assisted instruction and 
homework, preferably implemented on network connected 

15 computers, that overcomes these problems by providing the 
following objects in preferred and alternative embodiments. 
This invention provides a more effective system responsive to 
the needs of several parties interested in education. 

An important object of this invention is to provide the 

20 student with a virtual tutor, by having agent software 

("agent") adapted to each student that offers a high quality 
of individualized student interaction and that manages or 
controls instruction in a manner approximating a real tutor. 
The agent exercises management or control over the computer- 

25 assisted instruction materials and provides information and 
help to the student, both synchronously and asynchronously to 
particular instructional materials. Agent behaviors are 
sensitive to both the educational context and to the history 
of student behavior. 

30 In a preferred embodiment of this invention the agent 

integrates data from several sources. From computer-assisted 
instructional materials, it accepts data on the methods of 
instruction adopted by particular materials and on student 
performance in the instruction. From the student, it accepts 

35 direct interactions as well as using the history of previous 
student performance stored in a student data object. From 
the teacher, it accepts data on customization and student 



The 



WO 97/44766 

PCT/US97/08685 

assignments. From the school, it accepts data on assioned 
courses, data on analysis of student body perforl 
educational standards and criteria. * ZllZT' "* 
embodiment, these inputs allow individualization of agent 

SZTT* "^^^ eBb0diDentS " e -Ponsive to 
additional data types and sources. 

In a preferred embodiment of this invention, diverse 
agent behaviors are handled uniformly by a single meaT 
diverse behaviors include encouragement and feedback 
10 providing meta -cognitive help on on goi ng instruction' 

managing or controlling and individualizing computer 'based 

student,s iearni - — ■ - e 

with assignment management. These diverse behaviors are 
selected from a set of potentially appropriate candidate 
15 behaviors. This set of candidate behaviors is ordered and 
the highest ranked behaviors are chosen. 

aaen/* ! Pr6ferred ****>*i»*<* of this invention the diverse 
agent behaviors adapt to the student based on a variety of 
information about the student. The agent modifies its 

wlthT \" T baSiS " 3 9rOWing hiSt ° ry ° f ^-eractions 
with the student over time, as this history of student 

performance is stored in the student data object. The aoent 
can also modify its behavior on the basis of 'teacher an! 
school system supplied information. 
» Further, in this preferred embodiment, the student data 

o^ect resides on portable media in the physical control 
the student. This is advantageous because the student data 
object accumulates data personal to the student, and its 
privacy can be ensured by such student control 
30 Alternatively, the student data object can be stored on 
central server computers in secure databases when this is 
advantageous to ensure student data privacy 

object of this invention is that the 
agent presents itself on-screen to the student with 
35 integrated, and optionally, animated multimedia persona or 
preferably a plurality of persona (hereinafter called 
"personae..). The on-screen agent can appear as living 
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entities, which in grade school can be comfortable "Study 
Buddies*" and in adult training can be appear as an objective 
"Concept Coach". The on-screen agent instructs, motivates, 
engages and guides its student. 
5 in a preferred embodiment, the on-screen agent can be 

dramatized by a single character or by a cast of interacting 
characters. The interaction between these actors can be 
individualized to reflect the pedagogical response of the 
agent. To maintain student interest in the agent response, 
10 story lines continuing across materials or session can be 
used. 

In a preferred embodiment of this invention the voices, 
gestures and motions of the personae are derived from the 
chosen behaviors, student personae preferences, and the 

15 history of recent behavior by selection from tables 

containing a rich variety of alternative sound and visual 
display objects. All elements of the on-screen agent display 
are then synthesized in an integrated display script calling 
for graphics, animation, video, or sound as appropriate. 

20 These scripts are then bundled into applets, run-time program 
fragments that represent a complete element of performance. 
This display is highly configurable by the student, the 
teacher, or the system administrator. 

It is an advantage of this invention that elements of 

25 the display objects can be created by artists, animators, 
singers, and so forth, as data snips. Pluralities of data 
snips can be stored in libraries of dynamic clip art and then 
installed in an implementation of this invention. In this 
manner the on-screen agent personae have an appropriately 

30 contemporary, realistic, and engaging manner. Data snips 
are, in general, short clips of sound, voice, graphics, 
animation or video, or combinations of these used to 
construct the on-screen agent. A data snip can also be a 
complete pre-f ormatted animated sequence, perhaps in the 

35 format of a talking animated daily cartoon strip. 

Another important object of this invention is that the 
interactive, adaptive, and self -paced computer-assisted 
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instruction and homework provided by this invention is 
available to geographically dispersed students and from 
geographically dispersed schools or education providers 
Accordingly, the system of this invention is adapted to"both 
5 the student data object stored on portable media and to the 
access of other important data across a variety of networks 
For example, an implementation of this invention as a 
"Homework Network- can make computer assisted homework 
available to students of all levels at home, m addition to 
10 computers located at residences of students, the student can 
also access homework materials at computers located in youth 
centers, libraries, schools and other locations. A stu Lnt 
only has to access a networked computer and "plug in" the 
portable student data object to receive instruction 
15 Alternatively, the student can access the student data object 
across such a network. 

In a preferred embodiment, the network on which this 
invention is implemented as an intranet configured of 
appropriate links and utilizing the known TCP/IP protocol 
suite, and as appropriate, ATM technologies, including World 
Wide web, associated browsers, and mail format extensions, 
implementation over the public Internet is equally preferred 
xn cases where extensive connectivity is needed. 

A further important object of this invention is to 
25 utilize augmented computer-assisted instruction materials 
which present to students a variety of interactive, adaptive 
and self -paced computer-assisted instruction and homework ' 
materials in a manner which informs the agent of a student's 
progress and performance and which permits the agent to 
30 manage or control the materials to the student's pedagogic 
characteristics. Thereby, the ABI system can effectively 
guide and engage students in their educational tasks. 

In a preferred embodiment, these instructional and 
homework materials are composed of materials data presented 
35 by a materials engine. The materials data includes display 
objects containing the substance of the instruction, logic to 
sequence the display according to student input, and 
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notations. Notations are augmented definitions that serve to 
pass information to the agent concerning the materials and 
the student. For example, notations classify key sections of 
materials which are educationally significant student 
5 actions. Preferably, authoring tools assist in developing 
these augmented instructional materials. Materials tasks and 
sequences are created and entered by instructional designers 
and subject experts. Notations are usually entered by 
instructional designers and can be customized by teachers. 
10 In a preferred embodiment, the information passed in the 

notations is standardized according to an instruction 
materials interface standard. This standard establishes a 
uniform way the materials independent data relating to 
student performance are to be provided to the agent and a 
15 uniform way for the agent to guide the student in a materials 
independent manner. 

A further important object of this invention is to 
provide to the student a range of tools which are integrated 
with the agent in a manner similar to the instructional 
20 materials. These tools include general tools helpful to 
assigned instructional tasks, and special tools for group 
work and communication and for student scheduling. 

In a preferred embodiment, the general tools include at 
least a calculator, an encyclopedia, a dictionary, a 
25 thesaurus, each appropriate to the several levels of 
students, which can access an ABI implementation. In a 
preferred embodiment, the group work and communication 
materials allow, when permitted, message exchange, student 
linking into groups for joint work, and student linking into 
30 groups for structured work such as contests, in a preferred 
embodiment the student scheduling tool records assigned 
student activities and their priorities. In an embodiment, 
this tool can be consulted by the student to view schedules. 
It can be consulted by the system to prescriptive ly schedule 
35 required activities, to permit student choice, or to permit a 
mixed scheduling initiative. . Finally, it can be consulted by 
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the agent to offer scheduling advice to the student 
Typically, student assignments are set by a teacher' 

perfol° bj T ° f inVenti ° n " reP ° rting ° f st ^"t 

S or to'thlr StUd6ntS ' t6aCherS ' ParSntS ' -i-i^.ti«, 
or oL aPPr ° Priate individuals in a business enterprise 

or other commercial versions. These reports include tZ 
unique data on the student's pedagogic performance 
accumulated and anal yZ ed by the agent, as well as all the 
usual and expected performance data on specific materials 
« -arable in existing computer-assisted instruction s'stLs 
in a preferred embodiment, data for such reports, called 
herexn school -student data, is forwarded by the agent 
pursuant to school policies to school server computers from 
the students' local computer, on the server computers It is 
X5 stored in server databases against which are run su" 
reports. Alternatively, this data can be forwarded to 
existing student information systems present at the school, 
in a further alternative eabodiBent where . n student 

20 the!! V CGntrally St ° red ' th " ^ be -'ivl from 
H i ' *' WMCh be St0 " d in a " oriented 
database system, it is an advantage of this invention in a 
school context that parents can have access to current data 
on thexr children, and thereby play a more informed role in 
thexr children's education. 

25 Another object of the invention is to utilize current 

technologies for student interaction. When available, this 
invention is adaptable to Network Computers ("NC") . NCs are 
low cost computers specifically designed to access intranets 

30 T bllC Internet - 10 3 CUrrent P" f *~ed embodiment 

30 and implementation, this invention is adaptable to multimedia 
PCs for some students, and to such special interaction 
technologies as can be advantageous to special students or 
students with special needs. Typical interactive devices 
include keyboards, mice or other pointing devices, voice 
recognition, joy-sticks, touch activated devices, light-pens, 
and so forth, other devices, such as virtual reality 
devices, can be added as they become commercialized. 

- 12 - 
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It is clear to those of skill in the art that by 
providing interactive, adaptive, and self-paced computer- 
assisted instruction and homework delivered over widely 
available computer networks this invention has immediate 
5 application in public, private, and commercial school 

environment of all levels. Educational research shows that 
instruction and homework of these characteristics improves 
students' educational outcomes. Further, in school contexts 
this invention advantageously provides* immediate access to 
10 student performance and pedagogic characteristics to all 
interested parties, including parents. 

«• BRIEF DES CRIPTIONS OF THE DRAWTMQfl 

These and other objects, features, and advantages of the 
15 invention will become apparent to those of skill in the art 
in view of the accompanying drawings, detailed description, 
and appended claims, where: 

Fig. i illustrates in overview fashion the principal 
functional components of and parties in the ABI system; 
20 Figs. 2A and 2B illustrate in overview fashion an 

implementation of the functional components of Fig. l; 

Fig. 3 illustrates an exemplary student display screen 
of the implementation of Fig. 2; 

Fig. 4 illustrates in more detail exemplary screen 
25 interaction between the on-screen agent and the instructional 
materials of the implementation of Fig. 2; 

Fig. 5 illustrates an exemplary interaction of a student 
with the ABI system implementation of Fig. 2; 

Fig. 6 illustrates in more detail the software 
30 components and hierarchy in the implementation of Fig. 2; 

Fig. 7 illustrates exemplary message flow through the 
implementation of Fig. 2; 

Fig. 8 illustrates agent action processing of Fig. 7 in 
more detail; 

35 Fig. 9 illustrates agent behavior processing of Fig. 7 

in more detail; 1 
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Figs, ioa and 10B illustrat-o ^ 
data object of Fia " lllu8trate the structure of student 
Ject of Fl 9- 7 in more detail; 

dat* F k 9 ' 11 illUStrates e ^»Plary processing of the student- 
data object of Fig. 7. student 

c 5 * - DgTA ^BP PBBPW T PTTOM n, — TTTTTTTTTrill 

sec. 5.1 presents a general overview of * 

h« dM and operatln9 so(tware co „ fi9urat . OT ^ £ «»" 

in the following, the systems and methods of this 
invention are described in the context of a schoL 
25 with examples drawn primarily from JTJ , 

Thie . ftmaruy from elementary education 

This invention i s not so limited. it will be a » 
of skill in «-h. » 1 apparent to one 

anoli^ . T that this -vention can be 

Tripoli It le r 1S ° f PUbUC PrlVate * d ^on, from 
pre school through university, and to all f Q ™ c * 

3. « corpo r «. ^ ucation . In - ^ J-^ 

xnventxon has particUar utiUty i„ Mlting ^ 
tra^n, avaUaMe at schcol> at ^ offic ' «« «- 

, S " ' M '"P»i«Uy Versed students and to 

w„ tio „ ca „ „ appuea in ^^-^^r 
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where monitored interactivity and individualization are to be 
provided, as in child care or weight loss. 

The following glossary contains several terms frequently 
used in the Detailed Description of the invention. It is 
5 presented here as an aid in order to initially introduce 
important terms that are more fully described and explained 
in the following sections. 

Agent: agent software together with the data it references 
10 executing in an ABI system. 

Agent Based Instruction ("ABI") System: the novel 

instructional system of this invention, preferably 
comprising an agent for responsive, adaptive and 
15 individualized instruction of students and a network for 

distribution of instruction, which projects the personae 
of the virtual tutor. 

Agent Software: software modules that generate responsive, 
20 adaptive, and individualized behavior in the ABI system, 

preferably implemented according to methods from 
artificial intelligence. 

Applet: an executable program fragment advantageously 
25 downloaded to a client across the network, in the ABI 

system applets are particularly used to represent a 
complete element of on-screen agent actions , or 
performance, (e.g., a character scratching its head and 
saying an utterance) and can reference various data 
30 snips of animation, sound, and scripting information. 

Authoring Tools: programs used by instructional designers to 
develop materials data, such development includes 
inserting notations. 

35 

Cast: a plurality of persona ("personae") representing the 
on-screen agent. 
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Character: an individual persona in the cast of the on- 
screen agent. 



5 



concept coach: a possible alternative name for a persona in 
the cast of an on-screen agent that is suitable for high 
school and adult students. 



Data snip: an elementary piece of sound, voice, animation 
video, or a graphic; data snips can be combined 
preferably by an applet, to represent a complete element 
of on-screen agent action. 



Electronic Learning Friend ("ELF"): a generic name for any 
persona in the cast of an on-screen agent; also a 
IS possible alternative name for a persona suitable for 

middle school students* 

Instructional Materials: the components of a course of 

instruction, such components are selected according to 
20 the course and can include prerequisite tests, pre- 

tests, lessons, and unit tests. 

Materials Data: the content of instructional materials. 

25 Materials Engine: software modules that reference 

instructional materials data and tools data to present 
the instruction and the tools to the student. 

Meta-request: a student request directly to the on-screen 
30 agent, an exemplary request is 'asking for a hint.' 

Meta-response: all responses to a student produced by the 
agent software, as distinguished from presentations by 
instructional materials, tools and communications. 

Network: the hardware and software connecting student client 
computers to school servers in an ABI system; the 



35 



- 16 - 



WO 97/44766 PCT/US97/08685 

network connections can comprise fiber optic links, 
wired links, or terrestrial or satellite wireless links. 

Notations: interface information inserted into materials 
5 data that causes the materials engine to send and 

receive messages from the agent software; preferably 
notations create standardized interface messages between 
the agent and the materials. 

10 On-screen Agent: presentation by the agent software on the 
student's display using such media as sound, voice, 
graphics, animation, video, or other multimedia 
modality; this presentation preferably displays one or 
more life-like personae. 

15 

Persona: a character in the cast of an on-screen agent. 
Personae: the collective plural of persona. 

20 School-student Data: data about each student's educational 
progress collected centrally; this data is forwarded by 
the student's agent pursuant to school data collection 
and privacy policies; depending on these policies, such 
data can range from none to essentially the entire 

25 content of the student data object. 

Student Data Object: data about each student which the agent 
software references in order to provide responsive, 
adaptive, and individualized instruction to that 
30 student; this data is updated during course of each 

lesson and is advantageously stored as one object, or 
alternatively a few linked objects, on portable media or 
in the ABI system. 

35 Study Buddies™: a possible alternative name for personae in 
the cast of an on-screen agent that is suitable for 
elementary school students. 
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Tools Data, the content „ f tools supporting particular 
instruction,! .ateri.ls; tools can include * 
a calculator, or an encyclopedia; STr^T* 
tools data are tne content o f t h e dictionary, „e 
» calculator, or th. encyclopedia. 

Utterance, a text or voiced response by on-screen a,ent. 

1. n^ *" 3meB CO ™ S "^tner to 

e.ulat. a hu»,„ tutor; fro . an individual student's 

of a virtual tutor. s tne fortt 

20 

in view of these objects and advantages, Fig. x 
illustrates the principal actors and ^ * functional 

components in an ABX System These include, generally 

tealh „ ^ int6raCt With Student and with 

described below m conjunction with Fig. 2 to create a 
vxrtual tutor of student xox. student^! is £ ca \ y one 

30 „::ii tTrLr s rolied in a sch ° o1 ° r 

to ell !T T\ ySteB 13 ^ VirtUal tUt ° r individualized 
to each student, which fonned by the functioning of agent 
software 108 with student data object lw >, which stores 

tT^ZtT 8 ° f / tUdent aSSi ^— «« standards 

set by teachers and administrators ids. other actors not 

Lnxa 1 !" 9 ' 1 ^ * ""^ " ™~ -plicatLs, 

eiuciti::"' parents in the case ° f ^ « s ~y 
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Materials engine 102 presents educational content such 
as instructional units, homework assignments, and testing to 
student 101. The educational content includes instructional 
materials data 114, communications materials data 104 , and 
5 tools data 115. instructional materials data 114 include 
computer based instructional materials similar to those known 
in the art but, importantly, augmented with notations for use 
in this invention. The materials also include various tools 
115 appropriate to particular instructional materials, such 
10 as a calculator for mathematics, a dictionary for writing, 
access to on-line reference sources for research, and so 
forth. Further, materials can also include communication 
materials data 104, which define and provide communication 
with other students 105 for instructional purposes. Such 
15 purposes can provide, for example, the tutoring of one 
student by another more advanced student, joint work of 
several students on one instructional materials lesson as 
permitted, and educational contests, such as spelling bees. 
Further, this invention is equally adaptable to other forms 
20 of materials that function in the framework of Fig. i, in 
particular interfacing to the agent software as indicated by 
arrow ill, and that are useful in a particular application of 
this invention. For example, materials appropriate for child 
care contexts can differ from the above three classes by, 
25 perhaps, having different paradigms of interactivity. 

The structure and course of interactions 103 between the 
student and the materials is preferably governed by paradigms 
of educational psychology and sound educational practice, 
such as are described in the exemplary reference Englemann et 
30 al., 1982, Theory of instructi on: nrinciples and 

applications, New York: Irvington Publisher. At the most 
immediate level, for example, during homework or instruction, 
student 101 can make requests and receives responses from 
materials engine 102 and, in turn, materials engine 102 can 
35 make requests and receive responses from student 101. The 
materials engine can adjust its sequence of presentation in 
response to student responses. At a next level, the requests 
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and responses exchanged between the student and th. » «. • 
engine can follow several patterng ™ £ Trls T^ 

^zi^: ^r;: a :v hich ' for ~ 

responding, can ask for ^ hintSf ^ ^ r e 

such as a calculator, or other relevant assistance second 
the t udent _ ^ ^ _ e se ond, 

unit. Third, xn case of error, the student can reguest or 

automatically be presented with, appropriate repeaT review 
or r enedl tion naterials> Finany> ^ a P ^ 

patterns of interactions can be analyzed to provide more 
adaptive responses from the system. 

" „<= T T h6rS administrat °" 106 also interact with 

::r: ;. e ™ P r rr purposes ' as — * 

•For example, teachers can customize exist ina 

::z ia iv y a ** ing additionai itens ' 

fo^H ! > governin 9 interaction, and so 

forth. A teacher can create particular instances of 

IZIT TT le for one class ' a 9roup ' or — 

student. Further, although reporting of student progress 

25 1 :i: bly r curs by other means ' in ijzl* 

» the materials engine can directly report student progress to 
teachers and ad»i nistrators . For * * ^ 

tLcher"" 9 n ° tati0nS th " * ene « te ges for the 

30 Ma , A1 ?°' inStrUCtional ^signers can create, or "author » 

iiiziiT for us : in this invention - — — «» i. 

or Ldla 7" teXtb °° ks ' ^oKs 

or media material. They can empioy standardized curricula 
pretests such as criterion tests, post-tests, and 
standardized texts. Authoring instructional materials in a 
35 course suitable for interactive instruction typically 
comprises several steps, including decisions about the 
objects to display to the student, the sequencing of these 
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objects, and the interactions with the agent . The first step 
is the selection of objects which carry the education content 
for presentation to a student. Objects can include visual 
display items, such as text, graphics, animation or movies, 
5 audible display items, such as voice, audio and so forth. 
They can include input items known in the computer arts, such 
as buttons to select, selections to chose from, text to 
enter, hypertext and hypermedia links, functions to perform 
with student input, and so forth. The second step is the 

10 selection of the sequencing logic for the ordered display of 
the objects to the student and the educationally appropriate 
reaction to student requests and responses. The sequencing 
logic can reference instructional controls set by agent 
software 108, such as a command to increase example density, 

15 and preferably is chosen in light of principles of 

educational psychology and practice as detailed above. The 
tfrird step is the specification of interactions with a 
student's agent or virtual tutor, a key component of the ABI 
system. This specification is made by augmenting the 

20 sequencing logic with "notations , '* which are referenced, 
called, or executed by the sequencing logic during object 
presentation and that communicate with the agent, in a 
preferred embodiment by exchanging messages. In the ABI 
system, the agent builds an adaptive model of its student's 

25 pedagogic characteristics, in other words the student's 

cognitive styles, by monitoring the course of the student's 
interactive instruction. The notations are the means for 
this monitoring. Finally, in order to make materials 
available, the authored materials are indexed and 'Stored in 

3 0 the files of the ABI system, preferably on materials server 
systems . 

ABI authoring tools differ from authoring conventional 
instructional materials in that notations are present in 
these materials to enable the agent software to update the 
35 student data object, to monitor and modify the instruction, 
student's use of a tool, or a communication task. ABI 
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, .. ™- — rr - 

Guided hy this .odel, agent softwac . 10 , acts> °* 
10 .an.g. or control th. student's instruction and" - 
directly guide the student in orde r that t he tot. TZT' " 
can present education to each student in an optiL\ shT" 
best adapted to the student's evolving ahiuties Llls „ 
pr«erences. m other words, the agent hecc.' . virtul! "* 

tut Vus " J" 5 StUd ' nt ' S P ' rSOnal ~ 

tutor. First, the agent manages or controls i nS f n -• 

-dent lox by directly controlling °: 

its presentation of .aterials data 104. n. and 11, ll 

»atT- ! ^ """""^ or controls the 

da!. e " 91ne in tU ° — »• ^Cronous with .aterials 

data presentation, such „ when the .aterials engine 
encounters an appropriate notation in the data, L,.. an 

» :::„ n cnr requast '. and — f ° r - — — - 

asynchronous with the presentation, such as when th. .cent 
software adjusts control p.r...t.rs which th. .ateriaU 
engine references at decision points. Exa.ples of 
synchronous control are an instructional ..terial as*i„, th. 
agent for penaission to alio, the student to us. a tool T 
» receiv. a hint, or to be given reflation, or a 

zittTr 114 ' as,cl " , the £ " »— «... to 

per.it th. student to .„,„. i„ . particular type of 
=o M „„ication with certain other students. An exa.ple o, 
asynchronous control is th. agent setting of 
para.eters. such as coaching para..ters that th. .aterials 
engine uses to adjust its presentation, according tTZ 
pedagogic characteristics of the student. Exmplary coachin , 
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parameters include the time pacing of exercises, the new 
concept seeding rate and the density of examples. In this 
manner, the materials can present interactive instruction 
according to optimal values of the pedagogic characteristics 
5 or cognitive styles of each student as determined from the 
agent's observation of its student. 

Second, agent software 108 directly guides the student 
by exchanging communication with the student, as represented 
by arrow 112. Student communication also preferably occurs 
10 in two manners, synchronously, in which the student directly 
makes meta-requests of the agent tutor and receives meta- 
responses and second, asynchronously, in which the agent 
tutor itself generates a meta-response in response to some 
instructional event. Herein, requests and responses are 
15 prefixed with "meta" when they are exchanged directly with 
the agent. Meta-requests include student questions to the 
agent - for example: How am I doing? What should I do next? 
Could you say that another way? - or student requests - for 
example: I need a hint; I need help. The agent responds to 
2 0 each student question or request. Agent meta-responses can 
be generated, for example, when the student takes too long to 
complete an exercise, when the student makes a series of 
repeated errors, or when the student achieves good 
performance. Agent meta-responses can be drawn from such 
25 categories as reminders, encouragements, reinforcements, 
paraphrases, jokes, progress summaries, and so forth. 

Communication with the agent, represented by arrow 112, 
include direct student meta-requests that generate agent 
meta-responses. Other communications derive from 
30 instructional event messages generated and communicated by 
augmented notations in materials 104, 114, and 115. An event 
received by the agent can generate no meta-response at all or 
alternatively can generate an asynchronous type agent meta- 
response. At educationally significant points, as the 
35 materials sequencing logic presents display objects to the 
student and receives inputs from the student, the materials 
data author places one or more notations. When these 
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notation are referenced, called, or executed, important 
variables and parameters educationally relevant at this 
significant point are gathered into a message, along with an 
indication of the type of the educational event. These 
5 messages are events which are then sent to the agent For 
example, an educationally significant point is the beginning 
of a new instructional sequence. The corresponding event 
message can include an indication of the topic to be covered 
the expected level of difficulty, the expected time to 
XO complete, and the educational paradigm adopted. Another 
educationally significant point is the receipt of a wrong 
answer, in response, the materials can generate several 
messages: a first message can include the time required to 
make the answer, an indication of the type of error, and an 
15 indication of whether the answer is completely wrong or only 
* near miss; a second message can include text parameters 
("say-it" type message) if the agent chooses to make a 
specific text or spoken comment about the error; finally a 
third message can include the screen location best 
20 representing the error ("point-it" type message) to use if 
the on-screen agent chooses to point to the error or move to 
the location of the error. Another educationally significant 
point can be a long delay in receiving the next student 
input, at which point the materials engine can send an 
25 asynchronous message indicating the time elapsed. Tools data 
115 generate events similar to messages from instructional 
materials. Communications materials 104 can generate events 
recording a communication request or an initiation of 
communication with certain other students for a certain task 
30 in the case of shared work on one materials, communications 
materials can generate events recording how this student in 
progressing with the shared materials; in the case of a 
contest such as a spelling bee, events recording how this 
student is progressing in the contest with respect to other 
35 contestants. 

In addition, in a preferred embodiment agent software 
108 also receives messages describing the progress of the 
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student through specific instructional materials. For 
example, in the case of mathematics materials, such messages 
can include information that the student is making errors in 
problems requiring finding common denominators. These event 
5 message should preferably all information that can be of 
interest to teachers and administrators for tracking student 
progress and tracking course adequacy. 

It is important that communication between the student 
and the agent be engaging. Agent communication preferably 

10 utilizes all the modalities of input and output available in 
a particular implementation of this invention, including 
text, audio displays such as voice and sound, and video 
displays such as graphics, animation, and realistic movie 
clips. For example, in the case of a communication triggered 

15 by good performance, the agent can select the display of 
sound and video clips, from a data snips library, that the 
student finds pleasing. The agent can further make reward 
graphics available on the student's screen for a period of 
time. On the other hand, in the case of error the agent can 

20 point to the screen location of the error. 

Further, it is highly preferable that the on-screen 
agent can assume various display personae during student 
communication. Herein, persona means the effect conveyed to 
the student of the combined and coherent presentation of 

2 5 multiple display modalities to emulate a particular, 

apparently living, personality. For example, in the case of 
elementary education, this can be the selection of tone and 
animation to emulate a pleasant animal or a known cartoon 
character. In some cases, characteristics of the display 

3 0 persona can be selectable by the student according to the 

student's preferences. In other cases, the personae can be 
specified by the instructional materials, the teacher or the 
administrator overriding student persona preferences. 
Personae for an elementary school student can be selected 
35 from well-known cartoon characters and can perhaps be called 
"Study Buddies™* # M Persona for commercial or corporate 
education can be adapted to the organizational ethos and can 
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2TZ S « 3 " C ° nCePt C ° aCh '" dentations for 

intermediate levels can be called an Electronic Learning 
Friend rE LF..>. Even though the ^ ^ 

networ, software and database acts as the students virtual 
S tutor, fro* the elementary school students point of view \he 
^Study Buddies*" are his/her personal tutor. Healism Z' 
voice gestures and movement reinforce this relationship 
Dedafl gent S ° ftWare 108 in the Ml system builds an adapting 
pedagogy or cognitive model of its student in student data 
XO object 109 . This mod el is independent of specific Lter a s 
Event messages to the agent software from the materials 
ZZT P TT ly lnClUde ^ inf °- ati - which this 

conti n ; S a s U ^ 9enera1 ' ^ ne8S39eS ™ 

13 III 15 neC6SSary t0 deSCCibe and tri 2e the 

H d ,° r C ° gnitiVe *W 1- **>pted by the materials 

m an implementation of the ABI system. 

in a preferred embodiment, the student data object 109 
mc udes such data about a student necessary to the ag L 
evolving pedagogic or cognitive student model. Further it 
20 preferably also includes data concerning the student's ' 

2ZT\ St T ""^ Perf °— ce - ^e instructional 
materials being presented to the student. This latter data 
is mterpretable by both the agent and the instructional 
materials. Finally, the student data object can include 
^Y^fc-P** ~eas *«r the sole use of instructional 
materials. Data in the student data object is available for 

sisslonr 1 " 9 StUd6nt S6SSi0nS " Saf6ly St ° red betvee " 

30 portabll "T 1 * data ° bjeCt " Preferab1 ^ — ely stored on 
30 portable media m the physical control of the student A 
student " P lug S -i n .. such a portable student data ^ ^ 

on portable media as part of accessing an ABI system 
Preferably, this portable medium is a smart card, or similar 
device, which securely couples portable storage and 
35 processing in order to shield the actual data and, instead, 
present a message-based interface to the student data object. 
Alternatively, the student data object «n be centrally 
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stored on school computers and downloaded to the student's 
computer when the student access an Afil system. in this 
case, the student data objects are preferably stored in an 
object oriented database, although this data can be 
5 advantageously stored in standard relational databases. As 
depicted by arrow no, the student data object is referenced 
by the agent in order to generate its actions and is updated 
by the agent as it processes events and student roeta- 
requests ♦ 

10 Especially in the primary and secondary school context, 

the school can need to gather educational progress data 
pursuant to its data-gathering and privacy policies, in 
cases where no single school is present, as in the case of 
multiple, dispersed education providers, no such school- 

15 student data is generated by the agent. However, such 

school -student data 116, when present, can be forwarded to 
central school computers by agent 108. Also, school-student 
data can contain guidance to the student's agent, such as the 
school schedule. Accordingly, school-student data is 

2 0 accessed not only by the agent software 108, but also by 
teachers and administrators 106. As depicted by arrow 113, 
school -student data is referenced by teachers and 
administrators in order to track the student progress and to 
generate reports concerning the students and the materials in 

25 the ABI system. Teachers also update the school-student data 
to enter schedule information for the student's assignments, 
which can be referenced and used by the student's agent. 
Administrators update this data in order to enter the courses 
and materials the student must master and specify standards 

30 and criteria the student must meet. 

In an alternative embodiment, however, these various 
data can be combined. Student data object 109, whether 
portable or centrally stored, can contain both pedagogic and 
cognitive model data and educational progress data, the 

35 school-student data 116. Such a combination is particularly 
advantageous in the case of central storage of the student 
data object. 
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5 Fig i A system as illustrated in 

**g. l. A preferred implementation of this i„v«n- ■ • 
based on a dIumh* ^ invention is 

Th.-., "oring syste. software resources 

Therefore. .„ exempUry preferred ABI syste. iJ^L 

further includes one or .o,. Th * Syste » 

- -inistretors : 0 r 9 : r a ™ " uhich 

» Alternatively. the y can access th ABVsystTaTth • 

client co.put.r systems. * " ' heir 0un 

consisTof'tT""' 3 . 4 " "V > network which 

Although th. network illustrated in Fig 2A i« „, 
2S bus-type configuration as f„ , , , f * 

using collisi 0 rd.te«' C ""^ 

s. tched uls't "It— or non- 

o/slvlral ^ J ! Sntral " hiCh ~ te 

1 seve ^al LAN attached server svst Bme *.„ 

CATV cable or optical linJcT^ networks including 

» either .iT^^^^Su^ 

P-vat. packet switching networks. ,n the „.. r futur. lor 
-e „a 3 onty of students, local attach».„t 3 „ 7 is e^cted to 
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remain a lower speed access over the switched, public 
telephone network, in the more distant future, such lower 
speed local attachments may possibly be replaced by a higher 
speed access using currently developing high-bandwidth 
5 technologies. 

A preferred public packet switching network to which 
this invention is adaptable is the Internet. ABI system 
nodes can be linked to the Internet in any convenient manner 
known to those skilled in the art and can include security 
10 boundaries (known a firewalls) to prevent unauthorized 

access. Alternatively, an ABI system implementation can be 
an "intranet," that is a network constructed according to 
TCP/IP protocols but using private links of the types 
enumerated above, and as appropriate, ATM technologies. 
15 m more detail, student client system 201 includes 

memory 208, which is RAM type real memory or a virtual memory 
based on RAM type memory and a backing store. Preferably, to 
reduce size and cost, the client system has no permanent disk 
storage. When available, a preferable student client can be 
20 a low cost network computer <"NC»). A NC is a computer with 
processor, RAM, and network interfaces sufficient to access 
intranets or the Internet. A NC is preferable in cases when 
high-bandwidth network access is available. In cases of low- 
bandwidth network access, the client system can have one or 
25 more disc drives 209 which can be used as a pre-fetch buffer 
or a read-only cache. The disks preferably are magnetic, 
although in a less preferable embodiment they can also 
include CDROMs. This optional capability serves to enhance 
communications efficiency in cases where the network has 
30 relatively low bandwidth. Large files can be downloaded in 
advance of a student session or the student client can cache 
read-only data across sessions obviating the need for 
downloading such files. Such caching requires the operating 
system components to maintain some form of version control of 
35 the read-only data. 

Preferably, an ABI system also includes portable storage 
media 240 storing a portable student object. Each student 
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has physical possession of such * m-n • 

-i. 3,0 is accessed by cuent systM T ^ - 

.ppro Priat e Unk 24l . Advantageous a ; os ; " 

:^r:: ~ f °?" a - J = ~ ~ - iry 

altHJl; aCtu " data st ™*"«» of ti,. student 

a«. object are protected fro. accidental or .alicious 
alteration or da-oe by any foreign ,„f t „, re th «" ° 

««. M .„ d . .^processor. a o ^=» 

ppy disc, m tlus alternative, student data obiect 

» : :r. c r c :; a : ™ ie — - - — 

68 Can be scored m a securely encrypted for.-* <- 
Prevent unauthorised alteration of data values or Zl 
structures, student data object access fro. sucn Portable 
■edxa b«,i„ s with the loadin, and executin, o, a P pro"I,' 
executable ..thods by client syste. 20 1 IZL Zl, J 
» fetch and decrypt revested dat, elects 

for reference or for update !„ 17 " 4 

shielded fro. client sy«« 2 0 Ti^Z T U 

y ^ U1 - This invention is adaptable 

to other portable .edia for the student data object such ^ 
one portal, client co.puter for. and in the possession of 
35 one student which has that student's data object » 
permanently mounted component. 
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Alternatively, in cases where portable media are deemed 
inappropriate, the student data object can be stored between 
student sessions on a server and downloaded when a student 
accesses an ABI system at a particular client. 
5 According to all of these alternatives, a student can 

access ABI system services from any available client system 
at any time. 

The student interacts with a client system using any 
appropriate interactive input/ ou tput .( "I/O") modes 210. For 

10 input, standard devices include pointing devices, such as 
mouse 211 or a track-ball, age appropriate keyboards, 
optionally speech recognition, and so forth. Speech 
recognition will permit brief conversations with the "Study 
Buddies™ , " or other personae, in limited areas. The 

15 invention is adaptable to special input devices appropriate 
for particular groups, such as the handicapped, and to 
devices yet to be constructed. Virtual reality ("VR") 
interface devices such as VR gloves and VR display helmets 
can have immediate applications for special needs students. 

20 For output, preferable devices include computer display 212, 
for displaying objects such as text, graphics, animation, and 
video, and audio output devices for voice and sound clips. 
The audio and voice can be constructed from data snips stored 
as digitized sound files in libraries. Alternatively, voice 

25 can be synthesized from text. The invention is also 

adaptable to special output devices for special classes of 
students, e.g. the handicapped, and to new devices being 
developed. 

Fig. 2A also shows an exemplary screen layout for a 
30 student client that exemplifies the principal functions of 
this invention. The screen is preferably partitioned so that 
principal components of this invention are displayed; and 
important student actions are represented by icons or 
buttons. Thus, the screen includes materials and tools area 
35 220 to the left, agent area 215 to the right, and a system 
toolbar 218, which includes a student customization area 221 
at the top. The size of the screen partitions illustrated 
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preferably change from time to time in re SD on S * * 

the materials are. or the agent are. can enlarge Zi 
to the ire s=rMn ^ needed . Materials are! *„ ? * 
21 ln " rU « lon " "els, and communication 

"atenals to present visual display objects and for these 
co.po„.„t s to receive interactive input. This area 2 
further subdivided into display region 2 » and a materials 

on screen agent to receive meta-requests and to display 
synchronous ami asynchronous ..ta-responses . Also 

s l^TT U " eXMPl,lry ° n - SC " e " insisting of a 

single persona 216 and a meta-r.guest icon 217 Th. ! 

can move to other screen areas as reguired Both he 

15 counts are illustrated as appropriate for elements' 

education, other visual appearances would be approp r "te i„ 

218 for selecting particular available system components In 
particular, always available on this toolbar ar. Lection 
" icons „, for the calendar and scheduling tool, ^rt 
the system are, can be reserved for student custcizat 
for for th. display of reward graphics "given., to the 

student by the agent or virtual tutor 

25 me. """""""^ i"««r.ted i" Fig- 2A is an exemplary 

°n„ ry o° r9a """ i0 " °' * Cllent *•» • »»«n 

is in progress with materials being presented. Lay,, 22J 

ThTstft OPer " in ' S ° ftW "' a "" n " Wrk «-»i=«ions. 
This software provides, among other services, support for I/O 

,o ::::::: ? ,ch *: to th * • »*« - « ' 

« «d hT r 1 Pr<,tOCOlS ' "~ " TCP/IP and 

hl *e^-l«v.l network protocols, such as HTTP V2 o 

Executive software layer 223 provides basic shared AM 

system capabilities. The executive software verifiel nt 

identity and access authority establishes 

rity ' establishes communications 
35 sessions with the system servers as retire* during client 
start-up, downloads instructional materials scheduled for 
this student, and download executable software required from 



WO 97/44766 



PCT/US97/08685 



the systems servers as-needed. In the preferred embodiment 
using portable media, the executive software verifies that 
the contained student data object belongs to the identified 
student and accesses the methods of the student data object 
5 upon request, primarily, from agent software 225. m an 
embodiment with centrally stored student data objects, the 
executive software downloads the identified student' s data 
object from the student database. The instructional material 
and the software are read-only and are- not changed during a 
10 session. The student model is updated by the agent during 
the student session and modified parts are stored back in 
portable media 240 or uploaded to the student database on a 
server, such downloading can utilize higher level network 
transfer protocols, or alternatively, directly use lower 
15 level network protocols. 

Fig. 2A illustrates that agent software 225, optional 
components of student data object 226, and certain 
instructional materials software 224 have already been 
downloaded. The materials are displaying objects in screen 
20 area 220, and as indicated by arrow 227 are forwarding events 
to the agent and receiving management or controls from the 
agent. The agent is displaying its persona (e) in screen area 
215, interacting with the materials, as represented by arrow 
227, and is referencing and updating data in student data 
25 model 226, as represented by arrow 228. 

Arrow 228 represents different access methods depending 
on the embodiment of the student data object, in the case of 
preferred portable media with processing and storage, no 
components of the student data object are loaded, in memory. 
3 0 Then, arrow 228 represents direct message exchanges, or 
method calls, to portable device 240 made across physical 
link 241. in the case of portable media such as hard disks 
or floppy disks, arrow 228 represents method calls to student 
data object methods loaded into memory 226. These methods 
35 can reference or load into memory additional necessary data 
components of the student data object, m the case of a 
downloaded student data object, arrow 228 merely represents 
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1217 3CCeSSeS ^ data - Finally ' in the P^-rr- 

s^enT d , Where ^ iS SePa " ted the 

student data object and into school-student data, arrow 228 

further represents references and updates to such school- 
student data, preferably on school servers, such updates can 
xnclude school-related educational progress data 

Finally, the student client system further includes 
standard components not shown, such as a microprocessor and 

XO slTTT int6rfaCeS - "ternative ^mentations 
XO student client system are within the scope of this invention 
in particular, student client system function can reside on a 
server system. Purther, the client system can be implemented 
as two machines, wherein a first machine performs 

IS Tr S TTl lY ^ COmpUtations — a second machine i s 
15 for student interaction and sends student input and receives 

display instructions from the first machine. 

The ABI system further includes one or more server 

systems 204 of Fig . 2B with sufficient large capa 

20 HI f0t 1 St0ring 311 ^ool-student data, all instructional 
20 materials, and all software used in the system. Optionally, 
the servers can also store student data objects in an object- 
oriented database. The network is used to distribute 
software, instructional materials, and school -student data 
from these servers, m alternative embodiments, there can be 

dlvVr ^ SGrVer With S ° ftWare and data -tor.,, 
divided as convenient across the servers, m a further and 

less preferred embodiment, the server can be a central host 

system. m comparison to the client systems, servers 

preferably have increased performance and higher speed 

30 network connections 231 in order to make this stored data 
quickly available to the one or more student client systems 
Access to school-student data allows teachers and 
administrators to track student performance by class, grade 
subject, school and so forth. 

35 importantly, certain server systems can also perform a 

registry function, m cases where multiple schools or 
multiple education providers can be accessed by a student, it 
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is important to ensure integrity of that student's data 
object. In these cases, before allowing downloaded software 
to access the student data object, either indirectly through 
the agent, or, perhaps, directly, such software can be 
5 validated as being both a correctly functioning component of 
an ABI system and a correctly identified component, m 
particular, the latter check prevents foreign software from 
masquerading as legitimate ABI system software. The 
information for these checks can be stored as a registry 
10 function in certain common server systems. See, infra., 
section 5.2.4. 

The server systems are preferably configured as shown in 
Fig. 2B and are loaded with software 232 providing the 
following function. First, there is operating system, 
15 network services, and file server layer 233. m addition to 
the functions of layer 222 in the client system, layer 233 
also provides a file server facility including file backup 
and version control. System manger 234 includes facilities 
for access control, authenticating student access requests 
20 and limiting file access to authorized users. For example, 
students can be limited to only their personal files; parents 
to their children's files and curricular related data; 
teachers to files and school-student data for their classes; 
while certain administrators have unlimited access. The 
25 system manager can also maintain any necessary system logs. 
Instructional materials databases 240 and directories of 
executable software also reside on the server systems. When 
group communications is in use, agents and communication 
tasks monitoring the groups can reside on the servers. The 
30 servers also contain areas 237 for administrative data and 
for reports and report software of interest to the 
administrative staff. The servers also contain teacher areas 
238 for data and report software of interest to teachers. 

Finally, the servers contain student database 235. This 
35 database preferably includes school-student data, which is a 
source of reports for teachers and administrators and of data 
by which these staffs schedule student courses and 
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assignments. Preferably, student data objects in,, ,• 
*ata represents the pedagogic aodel of by 
the agent software, are stored in portable media 240 n 
this embodiment, the servers preferably provide an area 
S secure backup storage for these portabL data L ec t s ' 
Optionally, student data objects can be stored in an obi ee , 
oriented extension to student database 235 ' 

availir^' C6rtain inStrUCtionai «fri.l. can be made 
available specifically for the teaching staff, along with an 
10 ^-dualised teacher agent acting as a virtual tutor for 

to s 121 T: ^ f3CilitieS ° f MI S ^ «» * used 
to simplify teacher faffiiliarization and J 86 

custo nization (in thfi ^ of tQdayfs / r se an 

extb OOJc Further> ^ ^ n of 

for example, to assist in generating student reports and 
class management, m this case the server system contains 
20 special instructional materials for performing this 

instruction. Associated teacher data objects are implemented 

Tr TZT similarly to student data objects - ~ 

for teacher access have agents unigue to individual teachers 
Alternatively, the flexible server structure of the " 

theT Perm , ±tS adainiStrative - caching staff to perform 
their specific tas*s on any computer system with enough 
computing resources to support these tasks. As for sLent 
access, necessary system components are downloaded from 
servers to these temporary client systems. Thereby, these 

30 personnel are not limited to sessions on server systems 
Further, materials authoring can be done on server systems, 
client systems, or on separate systems not interconnected 
with a given ABI system. To make authored materials 
available, they are transferred to and indexed in the 

35 appropriate server system databases. 

Alternative implementations of the functions described 
for the student client systems and the server systems are 
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also within the scope of this invention. For example, it is 
known to those of skill in the art that by the use of various 
technologies, such as remote procedure calls or messaging, 
the functions pictured here as grouped together and on one 
5 system can be divided and distributed if needed. 

5,2 • avat— Hardware an d operating floftv^ * 

The system elements illustrated in Figs. 2A and 2B can 
be constructed on standard hardware platforms meeting the 
10 requirements discussed in this section. 

5.2.1. The ABI Bvatam Matwar t 

It is important that students or teachers be able to 
access an ABI system from any adequate client system anywhere 

15 at the school, at home, and when away from home, as in 
distance learning. Portable student data objects and 
networks permit students and teachers to participate at more 
than one school, and, further, permit delivery of homework 
and instruction to remote locations. In each case the client 

20 system must access instructional materials and ABI software 
from the network. 

In various embodiments, a student can access one. ABI 
system, as might be the case for a student enrolled at one 
elementary school. Alternatively, a student can have access 

25 to multiple ABI systems or multiple providers of ABI-system 
compliant instructional materials. 

Access to all system components is typically provided 
from ABI system servers attached to the network. Preferably 
read-only software and read-only instructional materials are 

30 provided from server systems. The advantages over local 
storage of these elements at client systems include 
simplification of version control and of access control. The 
student is freed from insuring the client system accessed has 
all the necessary software and manually transferring if not. 

35 Also server storage provides greatly reduced client system 
storage requirements, in view of the large amount of software 
and instructional materials in ABI systems. However, in 
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systems with limited communication bandwidth, it can be 
preferable to cache recently used software and instructional 
materials in order to shorten response times 

Networks suitable for an ABI system can be of any 
5 configuration and protocol that meets the system's client- 
server communication and object transfer requirements, where 
the client is either a PC or a network computer ("NC", 
Suitable networks can be private or public. The preferred 
ABI network in the case of PC clients, • according to current 
10 technologies, is an intranet running the TCP/IP protocol 

ZT r tUi2ing A ™ technolo * ies - appropriate, m one 
implementation, utilizing a single large server, such a 

Tr.r ^ direCtly C ° nneCted t0 ^ intra " et - ^ternet. 
In another implementation, utilizing several smaller servers 

15 these servers can be connected into a cluster by a LAN 
preferably an Ethernet LAN. lB this case , the ^ ^ 
built from a local Ethernet LAN with remote connections to 
telephone lines using 28.8 Kbps modems, or other network 
links. m an alternate implementation, the network can by 

20 visible to the public Internet if adequate security systems 
(firewalls, prevent unauthorized access. This can make wider 
access available at lower cost than by switched telephone 
remote connections. 

25 and ^ * ""^ COnnected °ther ABI LAN' s 

and to other networks, such as the Internet, by standard use 
of routers and gateways. An exemplary protocol for an ABI 
System network is TCP/IP supplemented with a client-server 
protocol such as HTTP and object transfer protocol, such as a 
multi-format mail protocol. ATM technologies are used as 

30 appropriate. Remote clients are expected to be indirectly 
connected to the ABI network. These connections can consist 
of routing over a public network or direct dial-in 
connections. These connections can be of either low-speed or 
high speed. The ABI system can be implemented on networks 
33 such as SHome (Mountain view, ca, , which use a combination of 
ATM, cable modems, TCP/IP and other technologies. The ABI 
system can also be hierarchically configured on new network 
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topologies for distance learning in areas with limited 
communications infrastructure. Primary central servers with 
ABI software and instructional materials communicate with 
remote secondary servers over broadband satellite 
5 communication systems. Student clients connect to the local 
secondary servers through wired or wireless means. 

5,2. 2. Th« Client Svatam 

Considerations governing the choice of client hardware 

10 and operation software are described next and are followed by 
a preferred client node system according to today's 
technology. These consideration depend on the content of an 
ABI system and the facilities of technology. As the content 
of a system changes and as technology evolves these 

15 consideration dictate that the preferred system will change. 
The client hardware consists of client input/output 
("I/O"), client CPU and memory, and client network access. 
Turning to the client I/O requirement, standard input devices 
such as keyboard and mouse, or other pointing device, are 

20 preferable. The client system also includes interfaces to a 
portable student data object. Such interface can 
alternatively include a smart card access device, PCMCIA 
ports, standard parallel or serial ports, or floppy disk 
drives. Color graphics output capability adequate to support 

25 partial screen animations is preferred. Sound generation and 
output are preferable on ABI client systems. Text-to-speech 
conversion can be done either in software or in hardware. 
When economically available, full video capability, for 
example by providing video decompression hardware such as 

30 MPEG decoders, and speech recognition, for example with 
hardware assists, are also preferable. 

The ABI system is also adaptable to special I/O devices 
appropriate to special student groups, such as the very young 
or the handicapped. These include, for example, simplified 

35 keyboards, touch panels, VR devices, and so forth. 

Client memory must be sufficient to contain resident 
operating system components, resident ABI executive software, 
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and dynamically loaded segments of th. c „ 
instructional materials, Z code nil **** 
aether with high p^anMncT^^^ 01 ^ 

is preferable to enable Koro graphlcs hardware and memory 

implemented in special iL ° f ^ ABI S ° ftwa " i- 

assists for thes TlT n l w SOftw «e 

where such .^^T^- P ^"" - - 
Mountain View, el) jav^ T " ^ <*" Mic " s ^tems, 

~JSr^ b ; a — — - ~ node 

uaptea to Internet communication »r*~~ 

— «... o, ., ivllent .^.^-^^r" - the 

allows the „ S e of lw oost " ^ SeSSlon ' *"» 

client co. PU t. rs . „:„:::: ~ appii "« «—* 

nuwKver , for those clients i 
speed netvorv 1Aenw with lower 

-imites. i„ the cas. „, \ ^ " takes ov « *° 

zr T ly ^..^ so£t j : « « e 

hard or floppy drivas „ ,«!! ,' Altecnat " el >'. P°"able 
to store JT^ZtZZTZTT 1 ' 6e 

approxi.at.iy too KB, ,„„ preferably !ess th!„ 

1 ». I» the case in „ hi o h the JL^JTjZT^*"* 

ent a «ta object is stored 
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on server computer, it is not be cached between sessions so 
that it can be accessed from other client systems. 

Client communication hardware can be adapted for either 
local or remote attachment. Local access requires network 
5 access hardware; remote access requires a communication 
capability. This invention is adaptable to lower speed 
access over switched telephone line services, preferably 
using 28.8 Kbps modems or ISDN interfaces (64 or 128 Kbps). 
These bandwidths are adequate for sessions with materials 

10 using only voice and limited animations. Pre-f etching and 
caching can be required to make fullest use of other 
materials at this bandwidth. This invention is also 
adaptable to high speed access over any available high speed 
links, such as Tl (1.5 Mbps) , T3, ADSL telephone lines, or 

15 cable modems (several Mbps) , or other means of high speed 
access. These bandwidths permit full access to materials 
without limitation. If economically available, high speed 
access is preferred. With greater communications bandwidth, 
the on-screen agent can appear more life-like. 

20 Standard client software includes an operating system 

and communication software. The operating system preferably 
has interfaces to client I/O devices including communications 
capability and network access, such as a TCP/IP stack. ATM 
interfaces are present if necessary. Preferably, it also has 

25 means for establishing sessions with servers, for providing 
file server services, and means for security as specified 
shortly. 

The implementation language or languages of this 
invention preferably have several features related to the 

30 implementability, maintainability, and extensibility of ABI. 
The implementation language preferably provides a degree of 
modularity similar to that provided by object-oriented 
programming languages. It preferably provides means of 
dynamically loading across a network and executing additional 

35 software segments during program execution. It preferably 
provides means of accessing all input devices and cf 
controlling the output devices in a high level display object 
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fashion. It preferably provides a threaded or 
multiprocessing capability. Less preferably thi • 
can be implemented in any computer lan^ in 
assembly language. language, including 

5 In Viev of ^ese needs and in view of th* r. 

technology, . currently preferred e^*** 

PC with a Pentium" 120 Mh 2 processor is ZZ" & 

disk drive a So »nHKi memory, a l gb 

rive, a Soundblaster compatible sound card wi*h 
speakers, . mBdixm performance graphics card ZJ 
10 Diamond stealth card with 2 mb 1/ ^. such « a 

Ftho „ . lcn MB of graphics memory an 

Ethernet card or a communication card and a 28 e K bL ^ 

implementation language. classes is the 

The functions of server system* n * +x • ■ 

^ i-r a :: nrr 
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simultaneously served. This number can vary from 20 at one 
school to more than 5000 across an entire school system. The 
number of servers and database distribution across a server 
cluster can be adjusted by means known in the art to satisfy 
5 projected peak loads, a suitable medium performance server 
system can be configured on a high end INTEL Pentium or DEC 
Alpha system with adequate memory and disk space. Windows"* 
NT is an adequate server operating system, and Internet 
server software similar to that from Netscape is adequate for 

10 network access. The preferred database is an object oriented 
database such as Objectstore. In this embodiment, 
application database access uses a common gateway interface 
("CGI") program also providing database access and version 
control. The CGI access program can be implemented in C++, a 

15 suitable object oriented programming language capable of 
accessing interfaces to Objectstore databases. 

5.2.4. ABI System Security 

Security and access control present additional client, 

20 server, and portable media requirements which are importantly 
part of an implementation of this invention. Security and 
access control can be maintained by careful selection of 
management policies, security software, and security 
hardware. These elements are described in this section in the 

25 order of authorizing and controlling access, operating system 
and network security requirements, implementation language 
issues, and portable student data object security. 

In a preferred embodiment, the primary means for 
authorizing and controlling access are passwords. System 

30 management of passwords preferably includes ensuring that 
user passwords are secure, not easily guessed, and are 
periodically changed. This invention is also adaptable to 
any other means of access control, including for example, 
passive and active identification cards and recognition of 

35 certain personal characteristics, such as voice. Access 
protection can be preferably provided by limiting access to 
system resources - database and file - based on a user's 
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in tne CCI application access programs. 

The operatin, system in clients and servers or this 
invention is prefers, ot . test.* security level. TMs 

IZil , P * inCr ""' i »f security for 

™ MChlMS - - networ* gateways that 

x. ria^"' ^ ~ ■-««-. « conten 

criteria, and monitoring software, such as tripwires that 
observe syste. .vents for suspicious cc^inatioL ^tl 
encryption can heip protect sensitive and valuable data 
illegitimate access by those without the *ey. Encr^tL 
hardware ^„*4. encryption in 

IS ZZ T bC Pr ° Vided accordi ^ to methods 

» Known in th. art, such as the Rivest-Shamir-Adelman (RS A> 

execu t F a°Le h n emb ° diBentS Md » at ~ ials that download 

executable code segments, the implementation language 

clTr 1 ' Sh ° Uld addrSSS S6CUrity e3 ™ s th- eby 

created. For example, a malevolent and knowledgeable user 
can create or modify the downloaded code to perform 
Ulegatxmate operations within the client system or access 
restated information from the server. The Java» language 
25 x, preferable in these embodiment because it now 
significantly addresses these problems and further 
improvements are constantly being made. Examples of Java- 
security measures include limiting access to client system 
resources, particularly the file system and network 
30 connections, preventing downloaded software from "spoofing" 
local software, and providing byte-code verification to test 
code for possible security violations. Any implementation 
language for an ABI system preferably offers similar or 
improved security features. 

35 studenff i° M l lY ' " " adVanta * eous t« Protect a portable 
student data object from being altered in an unauthorized 
manner, corrupted, or damaged. When ABI system compliant 
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materials can be downloaded from multiple ABI systems or 
educational providers, particular care is advantageous to 
ensure correct functioning of these materials. Such student 
data object protection is accomplished by validating 
5 downloaded software and by encryption and key management for 
the student data object. 

Software validation includes registration procedures and 
runtime access control procedures. Before software or 
materials can be downloaded, they are preferably registered 
10 with an ABI system registry function, which can reside on a 
network accessible ABI server system. Before registration, 
proposed software is formally or informally inspected to 
ensure that it is safe, that is that it does not cause 
illegal or undefined system states. As previously described, 
X5 a safety inspection is facilitated if the software is written 
in Java, which permits formal safeness checking. Also, the 
software is inspected to ensure that all modifications of the 
student data object are appropriate, that is that all 
modification reflect correct use of queried or updated 
2 0 fields. Upon passing these inspections, software is given a 
system identifier and its executable or interpretable forms 
are given a digital stamp by a checksum or cryptographic hash 
function to insure its identity. The system identifier is 
stored in the registry along with the digital stamp. 
2 5 At runtime, when the student requests access to 

particular ABI system compliant material or software from a 
provider, the student data object access control methods on 
the client system perform the following checking process. 
First, these procedures generate a request to the registry 
30 function to verify the software to be downloaded by providing 
the registry with the software identification, if the server 
responds that this software is not registered or authorized, 
the download request is rejected. If this identifier is 
validly registered, the registry returns the digital stamp 
35 associated with this identifier. The access control then 
downloads the software or material, recomputes the 
cryptographic hash function or checksum, and compares it with 
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the registered value, if they do „„«. 
downed revest is also "° Respond, the 

software is assumed to be safe and , ^respond, the 

the access control sets indxcat h ^""^ ^-tified, and 
S sue, access ^ ^ 

only particular exponents of the student d . "° 
with only read or read/updafce ^ ° bj6Ct ^ 

Additionally, during access to tho o- . 
the access methods can consult rules so that" ^ ^ 
10 ^correct patterns of access can b ly 

dearly excessive rate of nara^t- re3eCted ' For example, a 

i-aue or parameter update o»r. k 
rejected. upaate can be caught and 

In addition to software vaii^n 
access control encrvnM validat xon, procedures f or 

student object an . he Potable 

educational progress data • . ' °P tlo nally, 

» reasonable ,nd e(fective - -Meve 

student data „b ject advanta9eoua f1 ^; Pt-l. 

password, or other identification lnClua " the stent's 

second. t-'HLrt^- tr^r syst - 

-crypted whenever if. data is present * n I 
accessibie by the client syste. fr " ly 
such as portage herd or fLppTdisL th e 
» object data is stored encrypted o the d 1"' 
decrypted in memory onlv in ™ Portions are 

-thods. x„ e^oaTnent, ^TTT" *" 5, " Ci£iC 
-itn process, which "rovTde « ™=« cards 

as data storage the d.L I V P««.ssi„a as well 

» *-*. However'. .".rTi" "a " ^ 

Such ext.rnaliz.tion is necessarv in , «»>=nrpt«J. 

bacup facilities ere provided Z t I ° B *" 

P oviaed. For backup, internal data is 
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externalized as a encrypted, sequential, stream which can be 
stored and recovered from a backup system. 

Such student data object encryption can be supported by 
key management schemes known in the art. For example, a 
5 public-private key scheme can be utilized. A student's 
public key can be stored on the ABI system which processes 
student system logon requests, and returned to the client 
upon student logon. The private key is stored in a protected 
manner in the portable student data object. Thereby, after 
10 student logon to the ABI system and validation by the 

portable data object, both keys are available to decrypt or 
encrypt data as required. 



15 5.2.5. ABI System Usage Metering 

Each student receiving ABI instruction on a specific 
topic is presented with a combination of instruction, 
utilities T and on-screen agent interaction. Because the ABI 
System provides individualized interactions, each such 

20 presentation comprises a unique mixture of visual, audio, and 
software elements. Also, each user's consumption of hardware 
and communications resources differs. The ABI System 
therefore preferably incorporates metering technology to 
track the utilization of the different elements of the ABI 

25 System. Such information can be used to determine payments 
to the creators or providers of these elements and/or as a 
basis of charges to the user. Further, this information can 
be used by ABI System providers to determine absolute and 
relative usage of various components of the system. Parties 

30 interested in such information include providers of server 
hardware, application software, networks, instructional and 
tool content, authoring tools and on-screen agent animations, 
scripts and utterances. Finally, this information can be 
used to monitor system performance and utilization. 

35 Current metering technology does not provide the 

detailed measure of usage that is advantageous to ABI System 
providers. Such technology adapted for network distribution 
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5 software element? • , elements, standard 
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utilities such as dictionaries and encyclo J""'*' 
screen agent amotion and utterances. * °"' 

« ABI metering comprises the elements of tn . 

utility software », » «"«nts of the metering 
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/ asures usage and maintains usage data in a 
'multidimensional usage model' during each student 
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the system server fs» r„ , K student clients and 
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ownership of on-screen agent actions. The session and screen 
manager keeps track of which element of the screen is active. 

This invention is adaptable to any method for measuring 
usage appropriate to the particular component elements, in 
5 particular, four preferred methods of measuring usage are by- 
time, by-interaction, by-unit and by-packets. The by-packet 
method is performed at each server to track usage of 
communications resources. This method is preferably 
implemented by using a count of the number of bytes 
10 transferred in order to estimate the number of packets 
transferred. The ABI application software keeps track of 
counting the number of bytes transmitted to the user 
according to content type (i.e. system packets, instructional 
materials, or elf animations). Then based on the network 
15 transfer protocol used, the byte count may be converted to a 
roughly equivalent packet count. Alternatively, the byte 
count may be used directly as a measure. In the case of 
multiple servers, each server sends a summary of packet 
transmission information to a unique metering utility server. 
20 The by-e lapsed-time method is performed at the client. 

In this method, the Screen Manager at the student client 
keeps track of the multiple simultaneous on-screen activities 
such as instructional materials, the elf, and the dictionary. 
This method preferably further monitors the active element of 
25 presentation, that is, the element performing an action or 
the focus for student input. In a more limited alternate 
implementation, the connect time of the student may simply be 
measured at the server. To avoid network problems such as 
lost connections and missed session signoffs, the System 
30 Manager application at the server additionally periodically 
obtains session statistics during a user session, either by 
polling the student client or from timed client downloads. 

The by-units method is preferably implemented either at 
the server or at the client. This method measures the 
35 content accessed by the client. For example in the case of 
instructional materials, the server records the specific 
lesson accessed while the client records the comple on of 
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connect time, as frequently done for 



- 50 - 



WO 97/44766 



PCT/US97/08685 



Internet access, or on type and quantity of information 
retrieved, as is common for on-line database access. 

TABLE 1A illustrates an exemplary model for compensating 
providers of ABI system elements. Compensation is based on 
5 metering data and an allocation model. The four metering 
methods are applied selectively to different providers. The 
allocation amounts 'a', 'b' , 'C and 'd' are externally * 
determined. 



XO TABLE 1A: TYPICAL MODEL OR USING METERING INFORMATION 



25 



PROVIDERS 


COMPENSATION FOR PROVIDER 


Billing/ Network 


'a' percent 


Server Hardware Providers 


'bl' percent divided up according 
to number of packets with up to 
'b2' percent additional if total 
number of packets exceed a 
predetermined level 


Instructional Materials 
Providers 


'c' percent divided up according 
to units 


Calendar/ Schedular Provider 


Up to 'd' percent based on level 
of interaction 


Animation Providers 


'e' percent divided up according 
to 'time on screen' 


ABI Client/ server Software 
Provider 


Balance of revenue 







5.3. The Instructional Interface 

The ABI system has interfaces for students, teachers, 
30 and administrative staff. Materials and software developers 
can have specific ABI system interfaces. Alternatively, such 
development can occur on separate systems followed by 
indexing and loading of the developed components into the 
appropriate databases. 
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This section describes the structure and desicm of t ho 
stu dent . interface descriptiQn ^ -an e 

the currently preferred implementation of this interface by a 
5 series f visual display ^^^^ Howeverf ^ v c by 

not so limited, and adequate alternative technologies, for 
example voice output with speech-recognition input , can be 
used to implement this design. 



10 



5 " 3 * 1 - 1 ' B«— Diary student ^ 

one or" 9 Bateria;LS Presentation, a student sees screens of 
one or more screen types, all formatted in accordance with 
the previously described design principles, screens are 
structured as a hierarchy of areas and subareas with text 

III T' aniBati ° n ' and Perhaps video -i.Pl.y- in 

the subareas. Objects can either be for display only lr 
permit student input or interaction. 

An important screen type is a task screen. Task screens 
are used for materials presentation tasks such as homework 
20 assignments including problems, programmed steps, mastery 

fizzes, and drills. Table 1 and Fig. 3 illustrate exemplary 
components of a task screen appropriate for elementary 
education. Reference numbers in Table 1 are from Fig 3 In 
general, in system area 302, the session manager presents 
25 ob D ects visualized as icons permitting the student to easily 
access ABI system facilities. m materials area 304, object 
presentation including description, placement and movement, 
is specified by the materials designer in the presentational 
and sequencing sections of the materials data. The materials 
30 engine interprets these specification at run time to send 
display objects for display, m agent area 303, agent 
behavior processing formats predefined parametrizable 
ejects, including resolution of object parameters 
representing selected agent personae. The output from all 
35 selected and formatted display objects is sent to the 

executive software and operating system for ultimate display 
to a student. J 
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TABLE 1: STUDENT SCREEN DISPLAY ELEMENTS 



10 



REF 
NO, 

301 
302 
305 

306 

309 
307 
308 

310 



304 
15 311 
312 
313 
314 
315 



316 



20 



321 
317 

309 



25 



30 



303 



318 
319 



320 



35 



NAME OF ELEMENT 

Screen 
— System Area 

-Customizable 

— File System 



— Scheduling Toolbar 
! — Monthly Calendar 
| —Clock 

— Toolbar 



Materials Area 
— Open Book 

— Section Tabs 
— Exercise Area 
— Header 
— Presentation 



— Input 



— Navigation Buttons 
— Student Action 



— Sched. /calendar 



On-screen Agent Area 
— Audio 

— Text Message 

— Visual Persona (e) 



— Agent Request 



DISPLAY OUTPUT OBJECTS 

Entire ABI display area 

Graphics and text 

(can be animated) 
Book icons with titles 



Graphics 
Dynamic graphics 

Icons of tools (for 
calculator, word 
processor, dictionary, 
communications , etc . ) 



Graphics of book outline 
Graphics with text 
Text f graphics 
Text, graphics 
Text, graphics, 

animation, video 
Interactive objects 

(buttons, etc.), 

filling in text, 

dragging , drawing 

Graphics 

Icons for Submit, Help 

Graphics for calendar 
with text of student 
schedule, icons for 
scheduling options 

Synthesis of spoken 
utterance 

Text utterance 

Appearance integrated 
with audio, graphics 
background effects 

Interaction 

with other screen areas 

Agent meta-request icon, 
generates pull-down 
menu of meta-reguests 



In more detail, the task screen of Fig. 3 includes in 
system area 3 02 student customization area 305. In the 
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on-shelf ■ metaphor. Tnis inv .„ tion u >d ™ » 
re.scn.bl. file system displ '° oth « 

file holding ongoing instructional materi , ls a 

» -ii M til .= tor tooXs sucn as . dieti : n ;/ a - « - 

activity. Belo. fixe systen toolbar , J^/™* 
tools the student has access to . IllMt „ ° £ ° r 

starfish, a g.„. ral purpose language tool 

" „ , "" a " i,h " a 'l«»Uz.tlon tool for semantic 
networks that can be available in an AM System . 

™ :r aliy ~ n ° ists « — „™; 

""axizes ^ nl "" nt ™ * starfish tool 

visualizes such a network for a student by displaying the 

links dxsplayed as arms of the starfish. P or example, a 

words, root words, and so forth. A dictionary starfish 

Witt!' 5 : " 0rd ^ " S b ° dV - E3Ch — ~ "° »™ * -"led 
forth C ^ e9 ° ry " Sy " 0ny "' """"^ -—""ion and so 

r 9 °" a " "™ M,1SeS the "'"sPondin, word,s, 

dLoTa ^ : yed " 5POk *"- S " Ch « «— integrated 
display of diverse knowledge structures for a student 

The scheduling/calendar tool is an important tool that 
is always available. Exemplary icon ,» iliustrated for this 

each of these parts brings up daily and monthly scheduling 

» „:: t " ns \ Th,se fu " ction °" eit - r *- «- ~-s 

time or d r Per " U Ch ° iC '' ""*" ** """X «— 
tin. or demonstrated personal scheduling ability. 
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In materials area 304, instructional materials, tools, 
and communications materials display their content. 
Illustrated in Fig. 3 is page 3 of an exemplary mathematics 
homeworJc. Instructional materials are advantageously 
5 structured as a book of exercises and items, emulating 
current textbook and workbook practice. In this case, 
section tabs 312 permit the student to navigate the homework 
book by sections, and page buttons 321 permit the student to 
navigate the homework book by page. Also present is toolbar 

10 317 of available student actions, which for homework includes 
submit and can, if the agent permits, include help and hint 
requests. The format of a materials page is advantageously 
standardized. An exemplary standardization has header 
information 314, presentation 315, and interactive input area 

IS 316. 

On-screen Agent area 303 allows the student entry of 
meta-requests and allows the agent to display synchronous or 
asynchronous meta-responses. This exemplary area illustrated 
in Fig. 3 comprises meta-request button 320 which the student 

20 can activate to display a list of currently available meta- 
requests. student meta-requests are generally allowed by the 
ABI system at any time. Requests may occur at the beginning, 
middle or end of instructional sequences, in choice screens,' 
in tools, in group communications, or in the calendar. Agent 

25 meta-responses are individualized and context dependent. 
Typical meta-requests are illustrated in Table IB. As an 
example of context dependence, if the request 'Where am I?' 
occurs within a lesson, a graphic representation of the 
lesson will be shown; whereas if the same request is made 

30 between lessons, a graphical representation of previous 
lessons and new lessons will be shown. The agent software 
attempts to respond based on the user's intention and uses 
the context and previous requests to infer the reason for the 
current request. 



35 
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TABLE IB: TYPICAL MBTA-RBQDESTS 




10 



TYPE 



Temporal: Tine remaining in 
current unit/session/days work 



Marker: name and description of 
current lesson/exercise; relative 
position in lesson e 



l?£tV R ! pe f fc of instructions: 
summary of what has been done 



^!°™ a ? ce: summary of work in 
current lesson 



META-REQUEST 



'loZ,l? " l0n9? ' ' H °*"™* 
'Where am I? » 



15 



Choice: Branch to take. e.g. 
which lesson to do next 



Purpose: function of current 
lesson 



Resources: assistance available 
at this point 



'Say it again.' 'Sav that 
another way . * y nat 



'I need to hint, 
help. 



'I need 



The instructional materials notations provide a 
framework for the agent software to keep track of the 

Cfo™T POSiti0n ° f ^ StUd6nt 10 ^ l6SSO - This same 
information is also available to the teacher for lesson 
preview and annotation. 

The remainder of area 303 is for agent meta-responses 

» T^llT^ 1 : ^ aUlti - edia ~™ *-d ^to personae. 
Illustrated are text message 318 and visual persona 319 that 
tyPically includes animation. Also possible is 
either text-to-speech or generated from audio fii es 
Fig. 4 further illustrates an exemplary screen 
interaction between the materials and the agent. Fig. 4 

30 shows only the content of materials area soi and on-Lreen 
agent area 502 of the complete display screen of Fig. 3 A 
mathematics homework material is displaying item presentation 
503 with input selection buttons. The student has selected 

35 ZIZ T" • ^ thiS «*^™^Y significant 

event, the materials send to the agent several messages 

generated by notations in the materials data, m response, 
the student's agent has chosen to act as illustrated. First , 
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it displays text 506 of the rule violated by the student 
answer. This text was sent to the agent by the materials in 
an event message for its use. Second, the on-screen agent 
points 505 to the screen location of the error. This 
5 location was also sent to the agent by the materials. Third, 
perhaps in response to a previous high or increasing error 
rate of the student, the on-screen agent presents a meta- 
response 508 commenting on the pedagogic nature of the 
student's error. Further, it activates a persona 507 to 
10 engage the student's attention. This persona can 

advantageously include animation, audio, and speech output of 
the displayed text. Thus, the agent software integrates 
speech utterances, visualization, display of text and 
graphics, and animation into a persona display for 
15 highlighting an educational event that the agent determined 
important based its processing of the current input, past 
student inputs in this lesson, and the student's pedagogic 
model generated over several sessions. 

Other screen types are of importance in an ABI system. 
20 For example, tools can have distinctive screen types 
appropriate to their nature, such as a calculator image. 
Choice screens can be used at the transitions between 
instructional sequences. They summarize what instructional 
materials have just been completed, announce status 
25 information, and list any materials choices now available to 
the student. These choices can related to instructional 
materials to be undertaken next or to optional, non- 
instructional materials, such as exchanging credits for time 
in a game room, access to e-mail, and so forth, that can be 
30 available to the student. 



5.3.1.2. Student Actions 

The inputs of a student or other user of the ABI System 
are preferably classified as requests, meta-requests , or 
35 data. A student request is an input directed to materials or 
to the system seeking a specific action. Student data is an 
input responding to a system request for information. For 
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10 educational ! »PPreciatio„ for a particular 
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questio" " 7 llC " i °" S - "»P=n S es. »et.- cespon s e s. or 

rii c «i student. Responses are all 

; ; Cc B Tzir i materiais — y and 

25 Met! rl ade ^cy or correctness of student input. 

Meta-responses are an d . spiays produced P t 

can be synchronous, generated bv 6 
reauest Q r- « w 9Snerated bv responses to a student meta- 
IZtf ' * SynChr0 ™ S *> generated by events sent to the 
agent fro* the materials. Questions are a particular for* , 

.. =pr=.t ~ =s 

an integral component of the tutoring interaction 

Fig. 5 illustrates an exemplary segment of the 

interaction of the student and the system that can occur 
3S e r 3 BatheBatics *— «*• It illustrates both hT 
35 responses and requests are distinguished from meta-responses 

and meta-reguests and also how the agent, through its'" 

observation of the student's current situation and its 
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contact with past student history, is able to guide the 
student better than the materials alone, which are only aware 
of the current context. This display is individualized to 
the student's current and past performance and preferably 
5 uses realistic, life-like on-screen personae to engage the 
student. Displays from the ABI System directed to the 
student are indicated generally on the right; inputs from the 
student directed to the ABI system are indicated generally on 
the left; and time increases downward. The diagonal arrows, 
10 as at 4 01, indicate that the message at the arrow's tail 
leads to the message at the arrow's head. 

This illustration begins with response 4 02 from the 
mathematics homework materials suggesting that the student 
use the calculator tool. The student responds with request 
15 4 03 which selects the calculator icon to request the 

calculator. Calculator application 404 is then activated and 
displayed by system components. Data 4 05 is a student input 
to which the calculator tool, and response 406 indicates a 
student error. This response was apparently not sufficiently 
20 informative, and data 407 is a repeated incorrect input to 
the calculator tool. The student's agent observes the course 
of this interaction as the calculator tool sends event 
messages to the agent. Upon observing the repeated wrong 
input, the agent intervenes with a asynchronous meta-response 
25 4 08 summarizing recent student inputs. The student responds 
with meta-request 4 09 to the on-screen agent for help, since 
the tool responses were apparently not sufficiently helpful. 
The agent's synchronous meta-response 410 suggests for 
consideration an entirely different approach to correct the 
30 student's recent error. 



5.3.1.3. System Responses 

The following general principles preferably guide system 
and materials responses and agent meta-responses . First, 
some display is to be made on every user input, if only to 
echo a character or mouse click. Second, a user is never to 
be left in doubt about the status of current tasks. For 
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asynchronously only after a relatively long period without an 
answer. Also, previous student interactions should be 
utilized. Repeated requests for hints should be noted and 
dealt with perhaps not with another hint but with 
5 remediation- The rate of prompts, advice, and hints should 
be adaptively adjusted on the basis of ongoing performance 
records. 

The actual content of a meta-response can be adjusted to 
the current situation by filling in parameters from event 

10 messages sent from the materials. See infra. The 

Instructional Materials Interface Standard ("IMIS") is a key 
element in providing information to the student in response 
to inquiries such as "Where am I?". The system then uses the 
information in the IMIS to respond, "You are halfway through 

15 the drill and practice on fractions," for example. A student 
request for further information can elicit a graphical 
response. The graphical responses reinforce the virtual 
tutoring aspect of the system by providing a greater level of 
detail in a format similar to that presented by a human 

20 tutor. The format of the graphical method used is 

individualized to the student's past use of system components 
such as previous graphical meta-responses and tools such as 
the scheduler /calendar. 

The structural information for the agent software to 

25 construct graphical responses is derived from lesson 
notations, previous student performance, previous agent 
responses (including graphical responses) and the 
scheduler /calendar. Marker requests use general notations 
for the type of lessons and specific notations for 

30 prerequisites. Temporal requests use notations of expected 
time together with profile information on individual 
performance on that type of material. 

Typical predefined graphical response templates include 
road maps (perhaps in the form of a train and subway map) , 

35 charts, table, graphics and icon flow charts. Colors can be 
used to the show relative levels of performance, urgency or 
dependency of elements. In response to a 'How am I doing' 
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The calendar scheduler is advantageously capable of 
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schedule data fetched fro. school-student data areas and are 
processed by the calendar/schedule tool. Preferably the 
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the student. The calendar/schedule tool and the student's 

Z , ° btaln SChe<iUle d " a b " h £ "» -hooi-student areas 
end fro. the student's personal schedule areas. 

1. Schedule reminder responses, which remind the 
.tern.? 1 T^"" n ° t " i ' 1 ° ta «- ^ " for 

2. Task sequencing suggestion responses, which suggest 
an order of assigned tasks hased on student history and on 
the assigned priority and deadline. 

35 task I'!' t in V StlMte "<*°»=«s, which estimate how Ion, a 
tas^ In t h °" ti,ing inf °™«°» entered as part of 

perfo™ " st ™=«°"»l "terials and on past relative 

performance for this student. 
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In one embodiment, the ABI system provides for of 
scheduling initiative to be divided between the student and 
the system. Settabie task schedule parameters permit, at one 
extreme, the student to have complete scheduling control, 
5 able to initiate and to exit any activity at will, and limit, 
at the other extreme, the student to work on only those 
materials that the system schedules. These schedule 
parameters include those controlling the tools and options 
available to the student while performing a given task and 

10 those requiring the student to perform background reading or 
remediation. Important initiative parameters include the 
scheduling values of task priority value and deadline. If 
the priority and date are not both "off", those tasks with 
greater priority and earlier deadline are automatically 

15 scheduled for the student. If these values are "off", the 
student has control of task scheduling. 

The system of this invention also includes a central 
list of timed activities, perhaps stored on the server 
systems, to be performed by the system. These can include 

20 regular times for the generation and printing of standard 
reports or for the broadcasting messages concerning group 
activities such as spelling bees. These timed activities can 
be performed by scheduling software which compiles the timed 
activity lists and initiates the listed activities at their 

25 listed times. Such scheduling software can be similar to the 
"at" utility in UNIX operating systems. 

5*3. 2. Teacher / Adminis trator-flvg tea Interface 

In the case where a teacher supervises a student's 
30 education, the teacher or the teacher's representative plays 
an important role in the ABI system. The teacher uses the 
system to perform such functions as entering initial profiles 
in student data objects and school-student data areas, 
assigning students to subgroups, previewing, annotating and 
35 scheduling assignments, reviewing and commenting on completed 
homework assignments, and reviewing summary reports. 
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controls key parameters in ^ student £ 
sc o 0l . student data area> vhich ^ J« 
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d^^et 9 ^ SUPerViS ^ -^1-tudent area and student 
data object par a meters, assigning and prioritizing 
assignments, and customizing materials. Important teacher 
activities are included in the following list 

10 control ^ initialiZ6S and ««rciB« continuing 

control over important data in the school -student data L 
» this manner supervises the student's use of the system 
For example, the teacher controls the access and lev el of ' 

XS "e s S tT? ble " ^ StUd6nt ^ UBitS the -ent tMich 
15 the student can alter agent personae. * 

2. The teacher controls the student's use of the ABI 
system by assigning , scheduling , ^ priori ™ 

student's access to the materials. This is accomplish by 
teacher control over the schedule subtype in the school- 

t~ha: ta Tr GXamPle ' - 

system taskl COBPl6ted ° n ^ SySte °' "on- 

system tasks, remove tasks or modify their priorities 

student Th " teaCher Can ^^omize materials available to the 
25 m^if 6Xtent ° f r ° Utine custo -«tion includes 

Items H SeqU6nCing ° f Actional lessons, elements, and 
items, choosing the homeworks the student must complete 

^ f ° raatS ° f hOBeWOrX assi ^"ts having some 

it! cretion - such as reports - ~ — - - 

30 4. The teacher's class management is aid ed by a 

usLTthe^r" BeSSa9eS ' reMinderS ' hintS ' etC ' to 
using the ABI system e-mail facilities. 

The system can advantageously assist the teacher in 

35 IT" 1 * ; ana9eBent - ° nce the ^udent completes and submits 
35 a homework assignment, a printed copy can be made for the 
teacher and the student. The homework assignment can be 
graded by the ABI system, if answers were provided as part of 
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homework material. The teacher can add comments for the 
student, if homework is viewed online by teacher. 

The system can advantageously also provide the teacher 
with summary and detail reports for each student and class. 
5 These reports can be immediately available online or printed 
for later review. As known in the art, reports can contain 
both current and cumulative data on instructional progress 
and homework assignments. The reports can also flag patterns 
of deficiency in a student's homework and problems in a 

10 student's instructional progress. In a preferred embodiment, 
these reports are generated from the database of school- 
student data forwarded to the school server systems by the 
students' agents. 

Additionally, the teacher can be a student. A teacher 

15 can benefit from training in the use of the ABI system in 

general, in the procedures to customize materials, and in the 
characteristics of the particular materials used in that 
teacher's class. This training can advantageously be 
packaged as instructional materials directed to the teacher 

2 0 which are otherwise similar to student instructional 

materials. In this case, the teacher, like the student, has 
accessible materials, a teacher data object recording the 
teacher's progress and pedagogical characteristics, and an 
agent using this data object to guide the teacher's training 

25 and guide the teacher in the use of the system. As for the 
students, the teacher data objects can advantageously be 
stored as portable teacher data objects. 

Other actors, such as school administrative staff, 
parents, and researchers, can play a role in the ABI system. 

30 Administrative staff can have privileged access to certain 
data items in the student and teacher data objects and other 
system data, which permits them to assign students to 
courses, to assign students to teachers, and to establish 
instructional performance standards and criteria which the 

35 students must meet to complete their materials. This staff 
can also receive online or paper reports on the progress of 
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students in the schools, the effectiveness of t eae „ 
the usefulness . S of tei »chers, and 

erulness of the particular materials assigned. 

Reports *t,a querifta 

5 Generation of reports from databases , ■ 

« object-oriented, ls . standard pr 4 k "'T 1 

elects of this task ere the selection of J* *' ™ ^ 
the report, the way l„ whlch selecte<1 a PP«« « 

whether i„ , sugary fon| , . . Z J 'r" 

" in which the data is cutout and , 

elements on the screen or ^e ^ " 

omplete sets of data o 
f ,. 1f .,. J ' some of these reports 



•ports Periodic reports nee. to he ,e„erate d t r^l 
interval These vary accordin, to population: by 
by class, by grade , b y school . Tft 

The reports can present/su^arize complete sets L ^ 
onjy data exceedin, stated llBits . sL^thes'^" 
° an<1 " 0ri ' — "cord ke.pi„ g regents 

>. teL "** " Par * ntS ' ThS »» also provld., 

« teachers and administrators with standard query™ and reoo« 
generating capabilities. 9 r,port 

..h aPPr ° Priat< '' par «"" «" aiso be actors in ,„ 
embedment of the ABI syst... A student's parents can be 

rapid .nation on their child's assignments L 

performance. This information can be mad. availabie at home 
on the same clle „ t systeI1 ^ their 

instruction and homework. 

" ,c= Pi r lly ' MUC " i =""' 1 ""archers can receive certain 
access to ABI systems in order to research the effectiveness 
-f educational theories and methods. For example, they cT 

IZlZ : " T - -ious education^ 

parades in certain instructional contexts by receiving 

IZZlZTiT to 5tud,nts pursuln ' 

according to the paradigms of interest. 
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5.3.3. Instructional Designer-system interface 
Designer Interface Overview 

Materials, in particular instructional materials, are 

authored by instructional designers. Authoring of materials 

5 can be done on the system on which the materials are to be 

used, or alternatively, on a separate system. Generally, an 

instructional designer authors materials including, for 

example, computer assisted instruction as known in the art, 

computer assisted exercises such a homework or simulation, 

x0 and computer managed student instructional tasks which can 

involve work with several materials. For all materials, the 

student's agent must be informed of the sections completed 

and skills acquired in standard formats. 

15 Designer Interface Details 

The ABI system provides an environment in which the 
student's agent is available to control materials 
presentation and guide the student to improve educational 
outcomes. This environment includes facilities to present 

20 assi 9 njnents * assess responses, probe for prerequisites, offer 
assistance with tools such as dictionaries, and score unit 
mastery quizzes. The system can advantageously include 
conventional forms of homework, such as work sheets, as well 
as new types of homework, such as group-based homework, and 

25 formats previously too time consuming for teachers, such as 
criterion based rather than fixed length or interactive 
rather than prescriptive. Advantageously, the system 
structure can accommodate existing forms of computer assisted 
instruction by embedding such existing instruction in 

30 mater i*ls <=>f this invention which contain notations and 
generate agent event messages. 

All authoring information below can be provided by the 
instructional designer, if preferred. In this case, defaults 
allow the teacher to enter only overriding information where 

35 needed. Alternatively, the teacher can be allowed or 

required to make various degrees of customization. In this 
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section, the term "exercise" means a single unit of 
instructional task. s *ngie unit of an 

<* text zz™ ::r::r io :°' ■ at,riais with — 

So«„,re. ^""nl " multi.edia Authoring 

existing authoring programs I** 
the attributes and behavior f M t I ^ T 

» . -to„ o: ~ r^rr • to dispi - 

software speci.ies sue ^r^Zuls " 'iT^ 
attribute. , uch as st „. ^ ^ " « 
function invoked by the object selection. "* 
Among the most widelv usbh 
IS products are Ma C m „ Ba " y avai lable 

p ucts are Macromedia's Authorware and Director 

-d other writers (Siffls , ^^e £j Ts wT? 
et al., Macromedia ^ ^ *' ^ ^ 

20 Multimedia ToolBook j. 0) . ' 

advan!^ PrOC6SS ° f 3Uthori ^ ■» instructional task is 
advantageously described sequentially to include the steos 
of, for example, defining the task P 
judging student i nputs 1^- ' exe "ise, 
25 «„ ^ inputs, defining exercise completion »„h 

25 augmenting the materials with * "Potion, and 

T „ «. K h nota tions for the agent 

in the authoring step of defining the task IT' 
instructional designer advantageously prides in oLt 
including initial instructions for t e ent t °" 

written and preferablv ,i aSk ln a 

Preierably also a spoken format with a n-«^ 
30 wordings as necessary for SB8 H al , alternative 

Homework sequencing can include a fixed order- . TT 

35 defined order- a s t u n»«f * ' 4 studen * 

aer ' a student defined order assi^ ^, *. 

P rioriti,ation into such priority croups as esse^iaT 
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important, or optional; and sequencing defined by performance 
to criterion on individual item subtypes. 

In the authoring step of defining each exercise, the 
instructional designer advantageously provides information 
5 including the following. The designer chooses names for this 
task and exercise, its prerequisites, and the skills to be 
acquired in accordance with school system standards so that 
the agent can meaningfully track student performance and 
provide helps, hints, and remediation. Next, the designer 
10 provides student instructions for the exercise, preferably in 
both spoken and written formats. Next, the designer 
specifies the presentation of the exercise by creating 
graphics and text for the exercise and by specifying their 
display attributes. Next, the designer defines allowable 
15 user inputs, the data type of input, and the display areas in 
which input is allowed. Finally, the instructional designer 
provides hints. Hints preferably include optional hints 
offered on student request or student inactivity and hints 
offered by the agent in case of totally inappropriate 
20 actions. 

In the authoring step of judging student inputs, the 
instructional designer advantageously provides information 
including the following. First, the designer defines 
standards for the completeness of requested inputs and 

25 actions, possibly none, in case of incomplete inputs. An 

exemplary such action is suggesting the completion of omitted 
inputs. Second, the designer selects how inputs are to be 
judged and the possible judgements, for example, correct, 
near miss, incorrect, and so forth. Finally, the designer 

30 selects error responses to individual input elements or an 
entire exercise. These responses can be uniform or can 
reflect the specific wrong answer. Error responses include 
retry policies and selection of remediation paths. 
Remediation can be item sequencing options given on the basis 

35 of retry outcome. 

It is preferable that response judging be performed 
according to certain standards established for a particular 
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implementation of this invention. Thereby tho 

-niter the student's pedagogic char " rL Z7 ^ 

i: r: t r ss . ai1 standardized — - - ^ r 

5 chl ! P ^ inPUt jUdging Can be ' wh «« appropriate ' 
5 checking the data type and perhaps range of an In Put P 

example, checking that a fraction is eLred L response ! 

faction addition problem Appropriate feedback can be ' 

if the wrong data tvee or ™n„- ■ 6 given 

y aua type or range is input. Single stiirt 0 „*. 

inputs can include entrv ^ = • , ^ngie student 

A second step i„ i^, judging can ta cla „ if , „. 
a suitaMe input standaM error ct^crils ^ rr " ^ 

Pattern corresponding to a correct answer The JZl 

seiected fro. a lifted mmber o f standard Judgements of 
correctness and partial correctness. This udge^t "then 

communicated +r> . j««ycment is then 

» to gu ide !ts student 7 r " DeSSa9e ^ '~ It 

guide its student and adapt its pedagogic model. This 

xnvention is adaptable to templates and pattern ma^hlna 
procedures known in the art paccern matching 

tne art. Patterns can include one or- 

screen, shapes of drawn obieet<! - 

inputs. o^ects, maze traversal, and tool 

35 M n T T rnin9 t0 ^ aUthoring step of defining task 
prlv d ' ^ inStrUCti ° nal ^si g „ er advantageously 

Ld :i7 t ation te i„ PUt , e y xercise , 

task completion. The materials can reguire a certain 
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minimum completion before allowing homework submission to the 
teacher. 

The final authoring step is augmenting the materials 
with additional notations for the agent. These notations 
5 concern task and exercise subject, skill classifications, and 
definition of the educational paradigm embodied in the 
sequencing logic, it is performed by instructional designers 
or knowledgeable teachers, and is expressed as notations in 
the materials that generate event messages for the agent and 

10 that reference control parameters set by the agent for 

control of materials sequencing. The notations so entered 
communicate various types of information to the agent. 
Exemplary types include characterization of assignment by 
type of task, subject, elements of subject covered by task; 

15 comparison between exercises in same assignment by similarity 
and difficulty; the subject matter prerequisites to determine 
what the student may or may not have mastered based on which 
exercises are answered correctly; system knowledge 
prerequisites; and scheduling information such as average and 

20 expected time to complete. 

5.4. ABI svst— Software Structure 

This section describes in a more detailed fashion an 
exemplary structure for the software components previously 

25 described in a more general fashion with reference to Fig. 2. 
Subsequent sections describe particular components in an even 
more detailed fashion. The structure described here is 
exemplary. This invention is adaptable to other structures 
with other allocation of the functions of this invention to 

30 different modules. Such alternative structures are easily 
designed by those of skill in the arts. 

This section first describes the principal client 
software and data components and the conceptual hierarchy 
which reflects their interaction. Next, the structure of the 

35 executive software is described. Finally, the flow and 
processing of events through the system are described. 
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Fig. 6 illustrates the princioai I 

-at, co-ponents and the co J ri - P h ° er °^" ~» « 

t„. ir interaction . The 1 ^ uil ^nn^? l ~ t ' 

libraries with associated controis « thl " 
executive software 602 ,.~.» " leVel ls 

the requirements of f hio ( ^. derating system to 

Cs of thls invention and also extend ^ •* 
15 needed. For example, all OS task creation i 

throu gh an ES task control faciht ? f ^ ™ ed 
student accesses only permitted Jerials " he 1 
also provides a preferred animation facin ty l d ' 
client startup. facility and controls 

20 e „ ! eSSi ° n SCree " manager 603 is «l~y. Present on . 
client system. This component partitions tL 
areas f or the principal ^ ^ 

,ene rally illustrated fay ^ ^ - - h s * een 

controls the system area, area 302 in Fia T L ' "* 

currently permitted to access this function b^o 
with OS task creation ^ "nction before continuing 

an uha , creation. The system manager also presents 

nject «u for the student in session on the client Thi, 
lotion, state' ^TiJ^^^^ 
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themselves, is preferably accessed as previously described 
from portable media. Alternatively, it can be downloaded 
from the server systems when the student logs onto the 
client. Preferably, this object is divided into components 
5 including methods and data subtypes, and those only those 
components required are actually accessed at any one time. 
As indicated by double headed arrow 616, the student data 
object is accessed and updated primarily by agent processing 
functions 609 and 612. 
10 In a preferred embodiment, school specific data is 

separately stored in school-student data areas 615. As 
indicated by arrows 608 and 614, this data is preferably 
accessed by ABI client system components other than the 
agent. School-student data is preferably accessed from 
15 databases on school servers. In alternative embodiments, 
various subtypes, or all, of school-student data can be 
combined into student data object 611. 

Schedule /calendar component 607 is important for 
management of the student by other system actors, such as 
2 0 teachers and administrators. It is a tool that is always 
active whether or not it has a screen presence. Activities 
for the student, represented by activity description, 
priority, and deadline, are entered into the 
schedule/calendar data subtype of the school-student data 
25 areas by teachers or administrators. Optionally prerequisite 
information can also be entered into the schedule/calendar 
subtype. As indicated by arrow 608, this component 
references this schedule/calendar subtype data as well as the 
time expected for the student to complete an activity, as 
30 determined from the student's past performance and stored in 
the student data object, in order to determine whether 
certain activities, such as particular instructional 
materials, should be automatically started by the ES without 
any student intervention. In cases where the student is 
35 permitted greater initiative, the schedule/calendar can 
permit OS task creation requested by the student, as by 
selecting an icon. This component also provides, on request, 
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prioritized lists of tasks *k 

^ ^ tasxs for the agent to Dresent- i-^ 

student when the student asks fnr • present to its 

^wwwcnt <isks tor advice on what- *~ 
" uses priority a „ d deadliBe info „ atiOT IZ lLT-tlr 
cc^on deta ccputed using data i„ the inst'ctL' 
s materials and student d ata object. "uctional 

. at „ Th ? Mt,rialS "P"««ed in the A£I Sm .„ by 
sequencing logic during object presentation generate event 

d« a als : ; n :;r a i:"r:: a :r- 
d " n tia t u " tion entry - a t io „s r 

co-umc.te t, the agent the educational paradig. adopted bv 

» vt::Me" e t riai ;.r can in£ora th - -*« °< <*™o y 

Init iS " s t»" s »«- such he a d.r or 

xf the ..cecals change their ed»o a tion paradig.. In , 

nr r e h e " bodi,ent ' there is - — - »«.rT al s :„; in . 

» "te~\ PCeMntS ' PlUraUty " ""^^ «». " 

"™ et *° di ™" t - th '« "» specially , at e ria "s 

eng.nes for various = Ias ses or types of „ a teri a ls data 

d«. «"«"" 1S en,ine 6M do ™ loa <" ««ries of materials 
*«e "5. interprets the sequencing logic , dlsplays 

» the "' d ' " f «— — — -tetions genereUno 
feci^r "" t MSSa " 8 *° ~« 

and f «*„ °' °* ™" " ™ — '« Potation 
and for rout™, any input to the M t.ri al s. mput is 

processed according to specifications in the sequencing 

logic. In a preferred. eM»di..„t, the a , OT t controls L 

3» materials by setting shared giobal variables whicn the 

seauencin, Xogic checks. Such shared global varieties can be 

made available by OS inter-process communication ( . pc" 
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facilities, such as shared memory. The materials engine can 
be any program implementing these requirements, in particular 
an extension of available commercial authoring tools and 
engines, such as Macromedia's Authorvare. 
5 In an alternative embodiment, the materials are not 

separated into an engine and a data component but consist of 
one unitary component for each material. In this embodiment, 
a process similar to compiling creates a single executable 
materials component. This invention is equally adaptable to 
10 other implementations of the materials that generate agent 
messages and are responsive to agent control according to the 
requirements outlined herein. 

Agent processing is divided into two components, agent 
action processing 609, which determines agent display actions 
15 in response to events, and agent behavior processing 612, 

which transforms display actions into displays of personae to 
the student. As indicated by arrow 616, both components 
access student object 611. In a preferred embodiment, agent 
action processing is rule based and event driven. Rules in 
2 0 rules tables 610 are evaluated using parameters both 

communicated in event messages from the materials or the 
student and retrieved form the student data object. These 
rules propose candidate actions and then weigh and select a 
final set of agent actions from the candidates, which are 
25 communicated to subsequent agent behavior processing 612. 
Agent processing also sets global variables for materials 
sequencing and control. A side effect of this processing is 
the updating the student data object with information from 
the materials event message. 
30 Agent behavior processing 612 constructs an on-screen 

agent display based on the actions determined in agent action 
processing. In a preferred embodiment, this processing is 
based on behavior tables 613. Utterances, text or voice, and 
affects are selected from tables based on the determined 
35 final actions and refined with parameters included with the 
actions. The utterances and actions are sent to the selected 
agent persona object, which creates the agent display of the 
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selected personae using the utterances and effect „ 
-ta is referenced and ^ in ^ student -c s . 

this processing, in particular fields reflecting the 
student's agent personalization choices, such as the d„c • „ 
» Personae, and fields reflecting recent agent blv^ 

Also illustrated is communication materials 615 Theae 

:itt;; ls nana9e and provide — «~ ^l^i 

actxvxt es, sucn as student tutor . ng> ^ ^ * P 

- zt: r t r eriais ' ^ As indicated by 

arrow 614, these materials access data subtypes preferably 
stored in school -student data 615. Preferably 

5 * 4,2 ' The BMei itiv flnff». r t 

The executive software ("ES") collects tr*,-** 
» o f components which customize J J££ sy^m t VthT " 
eguxrements of this invention and, if needed: also Ittd 
in. ES software implements common and special facilities 
Exemplary common facilities include task control 
20 f C a °^" iCati ° nS ' — I/O facilities; exemplary special 
20 lt,es include a preferred animation facility and a 
client logon and startup facility, m a preferred 
implementation, ES software is built as frontends, wrappers 

ex r am D T S1 ° n : * " *~ 

25 and ! 17 be -P^ented in c or c ++ 

25 and directly call os interfaces, such as the windows- 
graphics device interface or its extensions, other 
facilities can be built as classes using available 
implementation aanguage libraries, such as the packages in 

30 part of soft faCUitieS ^ bS Pr ° Vided *™<^y « 

lllsZl PaC * a9eS ' SUCh 38 diS > la * *'° functions 

present m commercially available authoring packages 

The task control facility manages the startup of system 
compon ent First , it verifies ^ ^ * 

35 priori r^ 65 ^ * Peking scheduL and 

35 priorities with the schedule/calendar tool, indirectly the 
student's agent can be queried to determine if this 
activation is reasonable. Nex t, if permitted, this facility 
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manages the loading of required software from server systems 
and the accessing of data objects. Finally, task control 
then starts up the component by making any necessary OS 
calls. Task control also notifies other system components at 
5 task terminations. 

The communications facility manages network 
communications and provides whatever client-server or file 
server protocols are not present in the OS. Such protocols 
might include HTTP V2.0 with URL name resolution. It 
10 maintains all necessary network sessions, including sessions 
with the major classes of servers, including executable 
software servers and instructional material servers, in the 
case of portable student data objects, communication is also 
maintained with the registry function. In case of downloaded 

15 student data objects, communication is maintained with 

student data objects repositories. Data snip libraries can 
reside on any of these server classes. In alternative 
implementations these servers can be on one or several 
physical server systems. Finally, this facility handles all 

20 remote access requests for information including requests for 
downloading and uploading. 

The I/O facilities includes input and output display 
handlers for object level display I/O. The display handlers 
receive object level requests for text, graphics, video and 

25 audio and translate them into whatever interface is supported 
by the OS. The input handler receives low- level inputs from 
the OS input handlers and processes them according to the 
current screen format. In certain cases, it can directly 
call the output handler to perform immediate feedback 

30 actions, such as highlighting or dragging an object. In 

other cases, it can pass I/O event messages in an appropriate 
format to the system component owning that screen object, for 
example, the on-screen agent. The output handler receives 
object presentation specifications, such as system owner, 

35 position, characteristics, size, any animation information, 
and whether the object is an input focus, then updates any 
necessary screen mapping, and generates OS requests to 
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nee<S.d. or accessed fro. portabie Mdia if as ™" 
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litt-io _ Accessing can involve as 

kittle as powermg-on the computer and 

3. it: :::: rr:.* aoce ° sin ' — u. 

«n L resIdentTtV""' * iDtrM " «"* 

K„ . - r « siae »t ™ tbe client or downloaded by a power-on 
bootstrap process. Tbe student lo , s „„ ^ J ^ - 
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manager, which then performs authentication, for example, by 
means such as password or identification card. Upon 
successful authentication, the system manager downloads and 
starts the ES. The ES then initiates necessary communication 
5 sessions, including those with the system servers, and then 
downloads the session manager software, the agent software, 
and the scheduler/ calendar tool software. Preferably, the 
portable student data object in conjunction with the ES then 
authenticates the student and the student data object data is 

10 accessed from the portable media. Alternatively, the student 
data object is downloaded from a server. Then the session 
manager presents the student display in a form depending on 
student preferences in the student data object and receives 
input from the system area of the display. The 

15 schedule/calendar in cooperation with the agent then 

determines what materials the student is to be presented with 
or can select from. Finally, the materials data and engine 
are then downloaded and the substance of the student session 
commences. 

20 Presentations of personae or merely appropriate coherent 

responses can be created from audio and video display objects 
downloaded from a server and referenced upon demand. These 
display objects, or data snips, can be linked into groups 
corresponding to the particular presentations. Further, 

25 these linked groups can include small pieces of code that 
allow for a branching and interactive short meta-response. 
Thus, one meta-response can include opportunities for student 
input with the next display object being chosen in response 
to that input. Each of these groups is catalogued and 

30 referenced as that persona behaving in a particular manner. 

5.4.3. System Event Processing 

The ABI System on the student client, and on other 
clients, is advantageously organized to wait for student and 
35 timer input events and then to respond appropriately to these 
events. This is common current practice for constructing 
interactive systems. However, this invention is adaptable to 
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Practices that *i, h t be deveI 

constructs, interactive eysteL as £ '« . 
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Upon receiving • P° ss i*>ly after system startup. 

wLther "e " 1/0 """^ ™ 
for ot^s^c™ T *" ^ 

student action" ""^^ F ° r «» event can he a 

3» a tC ev.^ d:;::::'™ 11 ' " e - - or 

entirely proces" ed^ L . .^T" — - * 

resumes at 701 If h ' ndl ' rs - <"•" •»«« waiting 

701- If th. .v.„t represents a student" request 
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for the materials engine 703 or a meta-request for the agent 
711, the I/O handlers format it appropriately and 
communicates it to the correct component owning that input 
object. If the event represents a time interval set by one 
5 of the materials engines or by the agent, it is formatted and 
passed to the requesting component, in the case of group 
work, the event can be generated on a remote computer system 
and transmitted over a network link in order to reach the 
local I/O handlers. 

10 The I/O handlers format event messages into the format 

expected by the component they are directed to. They include 
in each message an indication of the type of student action 
or time interval along with any input information from the 
action. One input event can generate several events 

15 messages. 

Herein, messages directed to materials engines 703 are 
considered first; messages directed to agent action 
processing 711 are considered second. Although Fig. 7 
illustrates two materials engines, one engine or more than 

20 two engines are possible on a system from time to time/ 

Regardless of the number of materials engines present, event 
messages are communicated to the correct engine. The 
materials engines 703 process a plurality of read-only 
materials data 704 representing instructional materials, 

25 tools, and communication materials. As indicated by arrow 
725, these engines also access control information determined 
by agent action processing 711. This control information can 
be accessed in any convenient manner, such as by an exchange 
of messages or by referencing parameters stored in a shared 

30 memory region. This information controls the materials 
engines at educationally significant points during their 
materials presentation. Optionally, materials engines 7 03 
can also access remote databases 705 and other remote 
resources available through the system network. The engines 

35 use these two sources, and optionally three sources, of input 
to cause presentation 706 to the student of, for example, an 
instructional lesson, a homework exercise, an instructional 
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HT'-r^^ l° int CdUCational cont ^- ^is presentation uses 
dispxa, " " ^ " ° S " 96nerate — ~ 

As indicated by arrow 727, the materials engines also 
5 generate messages directed to agent action processing 711 
At educationally significant points during materials 
Presentation, notations in the materials cause the engines to 
format a message to the agent. These messages also include 

10 In : n " 1Catl ° n ° £ eVent **** «* "levant data, perhaps 
10 including timing data. One student input can generate 
several agent messages. At points which are not 
educationally significant, the materials can not generate 
agent messages. Thus, the system can wait again for the next 
student action at wait point 707 if the previous student 

ITT 6ither "° Si * nifi «nce the material or 

agent or no educational significance for the agent 

However, if messages have been sent to the agent, agent 

ltlZl r0 T' nq iS aCtivated ' In the preferred but not 
limiting embodiment, this processing is table based. Ru les 
20 from polxcy filter table 708 are evaluated in view of the 
data included in an incoming event message and in view of 
data on the student's past performance and the student's 
pedagogic model in student data object 712. For example 
comparisons with student history are needed to determine' 
25 relative performance. These rules propose candidate agent 
actions. Next, rules in decision weight table 709 and in 
selection criteria table 7io filter the proposed actions into 
a final l lst of agent actions. These final actions can cause 
the update of the information in student data object 712 with 
30 data on the student's current performance and behavior as 
xndicated by double headed arrow 728. They can also make 
available control information for the materials, as indicated 
by arrow 725. Finally, and importantly, the actions can 
include display actions for causing visible agent behavior 
35 The list of final display actions is sent to agent behavior 
processing 716. it is possible that no visible agent 
behavior is appropriate and that the list of display actions 
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is empty. In this case the system waits for further student 
input actions at wait point 713. 

Agent behavior processing 716 processes the final list 
of display actions communicated from agent action processing 
5 711 in view of utterance tables 714, display behavior tables 
715, preferences and the record of recent agent behavior in 
student data object 712 in order to generate a coherent 
display of the on-screen agent personae reacting to the 
previous actions. The final actions select utterance 

10 templates which are completed with parameters contained in 
the actions. The personae from the display behavior table 
selected according to the student preferences use these 
complete utterances to generate display objects, and perhaps 
animation scripts or applets, which are sent to the I/O 

15 facilities of the ES for final display 718. Agent behavior 
processing also updates the student data object with 
information concerning this current behavior. 

Having completed all possible processing of the student 
input action, the system now waits at wait' point 717 for the 

20 next student action or time interval. 

5 * 5 ' The instructional Materials And Th« T n »i. 
This section describes a preferred embodiment for the 
instructional materials, the student tools, and 

25 communications materials. In this embodiment, the materials 
have a uniform structure, being defined by materials data 
which is used by the materials engine to appropriately 
generate displays and perform functions. This uniform 
structure permits a uniform handling of the interface between 

30 all the materials and the agent. In alternative embodiments, 
certain tools and the group communication materials, for 
example, can be advantageously separately implemented as 
separate programs that themselves maintain the necessary 
agent interface. Such certain tools include a calculator, a 

35 dictionary, an encyclopedia, and group communications, in 
further alternative embodiments, each instructional material 
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could be a separate program that also maintained the 
necessary agent interface. 

This section f irst describes the general structure of 
the instructional Aerials and then describes the tools 
5 typically available on an ABI system. 

in a preferred embodiment a common materials engine 

XO an Zll S f SP6CifiC BaterialS data " ^ructi na i 

and tools functions. These are described with reference to 

^^r^^T- r ded f - 

P-erred embodiment ^ ^ £ 

presentation items, sequencing logic, and notations Th e ' 
» Presentation items include whatever is displayed, preflrLlv 

Th e e P s r eT ted " diSPlaY ° bjeCtS ' WhiCh be --me'tr 
These display objects can be packaged with the materials data 
or can be downloaded from a server on demand. The notati! 
contain additional data related to the material! di £ Ty 
20 These include, for example, prerequisites, links to re\ ate d 

The nota 1 ; ^ 6 ^ ' ^ ^ ™* ^s. 

The notations are preferably generated from templates 

referencing parameters from the materials data and student 

25 IneraTr" ^ ^ "~ to 

25 generate messages to the agent, which comprise one part of 

the agent interface. The sequencing logic is executable or 
interpreted code that animates the particular materials it 
references all data in the particular materials to cause the 
ordered display of the presentation items and to send 
30 messages to the agent according to the notations. 

The materials data is advantageously grouped into 
entries, each entry representing a minimum item of 
Presentation, which can, however, involve several screens. 
These entries are preferably specialized at least into a 
header or initialization entry and the other entries. Table 
2A illustrates a typical materials header entry which is the 
first entry processed when the materials are initialized 
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TABLE 2 A: 



HEADER ENTRY 



Instructional 
Header Entry 






Presentation 
items 


Sequencing Logic 


Notations 




Global variables; 
Global functions; 
Local variables; 
Local functions; 


Prerequisites for 
materials; 
Reference to other 
materials or standard 
texts. 

Agent initializing 
information including : 

- meaning of global 
variables ; 

- education paradigm 
adopted 

- available helps p tools 



10 



15 



This header has several particular features. The sequencing 
logic for the header frame consists largely of definitions of 
variables and functions. The global variables are shared 
between system components and include the control variables 
20 that the agent sets and that the sequencing logic references 
and tests in order to be guided by agent control. These 
variables, which comprise another part of the agent 
interface, for example, can control the time pacing of 
instruction, the new concept seeding rate, the density of new 
25 examples, the time pacing, or the difficulty of 

discriminations. Local variables are available to the 
sequencing logic during materials processing. Global 
functions are those global system functions that can be 
called by the sequencing logic. Also, dictionary lookup, 
30 spell checking, or encyclopedia lookup can be globally 
implemented and shared. In a Windows™ environment, the 
global functions can be DLLs. Finally, local functions are 
available locally to the sequencing logic. For example, in a 
scientific calculator tool, computations can be local 
functions. For a further example, in instructional materials 
the local functions are available for checking user inputs 
for correctness, scoring quizzes, and so forth. 



35 
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The notations in the header entry generate materials 
initialization messages to the agent. These messages inform 
the agent about these materials, about what global variables 
they respond to, about what helps, hints, and tools are 
5 useful, and importantly about the educational paradigm the 
materials use. Preferably, information about this paradigm 
is structured according to the instructional materials 
interface standard. See infra. The notations can also 
contain additional information, such as prerequisites for the 
10 whole materials and references to other materials and texts 
Finally, the presentation item can be, for example, an 
introductory screen. 

Table 2B illustrates a typical entry which is processed 
during regular materials presentation. 

15 

TABLE 2B: MATERIALS ENTRY 



20 



Instructional 
Entry N 

Presentation 
items 






Sequencing Logic 


Notations 


Display 
objects, 
possibly 
including 
those for 
text, 
graphics, 
sound , 

animation, or 
video 


Interpreted or 
executed control 
statements 
referencing 
variables, 
notations, and 
any student 
input , and 
causing display 
of display 
objects and 
execution of 
notations 


Prerequisites for frame; 
Expected timing, and 
difficulty; 

Relation to other frames; 
Links to other materials 
and sources. 
Changes to agent 
initializing information; 
Student performance data; 
Student error data 



25 



30 



For this entry, the presentation items are those for the 
materials display. The sequencing logic causes this display 
m view of the variables and other information in the 
35 materials data and any student input. Finally, the notations 
result m agent messages reporting changes in any parameters 
set at initialization, student performance data, student 
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errors, and other educationally significant information . The 
notations can also contain information specific to this 
frame, such as expected difficulty and timing. 

Turning now to the materials engine, its first 
5 processing step is to request the executive software to 
download the requested materials data from the instructional 
materials server. It next processes the header entry, links 
to global variables and functions, and sends initialization 
event messages to the agent . When presentation begins, it 

10 interprets or calls for execution the sequencing logic on the 
first frame. From this frame it proceeds to activate other 
frames as directed by the sequencing logic. Lastly, when the 
materials processing ends, any termination messages as 
directed by the notations are sent to the agent and the 

15 materials are deleted from the client. 

In a preferred embodiment, the materials are all 
implemented similarly. Most differences between the 
instructional materials, tools, and communication materials 
are in the presentation items and the sequencing logic, 

20 including different global and local entities. All materials 
are expected to have notations for generating agent messages 
that record materials initiation and termination and student 

. performance and errors. Preferably this information is 
reported in a standardized manner according to an 

25 instructional materials interface standard, see infra. 

5*5-2. The Tools 

The ABI system is adaptable to a wide range of necessary 
and optional student and teacher tools tailored to the 

30 students and the courses of instructions. In the case of 
elementary education , the following preferable tools include 
certain general tools and the communication, or joint work, 
materials. In the case of commercial education, other tools 
can be preferable. The schedule/calendar tool participates 

35 in permitting access to materials according to student 
schedule and is preferably found in all embodiments. 
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The discussion in the section is directed to 
Mentation for elementary education "1^", • ... 
- the tool, that can be used in an ^Jlll™ 

5.5.2.1. The Q»- T1 - .l Tn T l , 

The general tools are preferably present in , 
*«- selects according to in T 

areas. including , r .de level. a„ d teacher persons 1 
general tod u a calculator, which can havener! 
» , si-pie four function calculator to7c~o!. ""^ 

calculator, other w . ral tools includ 'LZT.olT^ 
•s a spemna checker, e thesaurus, a word p™ou„c e r ,„ 
encyclopedia, and , dictionary. „i„ere„t Lels^" eel 

i. iizt nr^zr™ suitabi « «- 

to place the center of a "starfish" ° WS the USer 

and then, by selecting L ^ * Particul « «ord, 

. ay selecting the appropriate arm of the starfish - 
obtain the definition, a pronunciation of the word r 

° a synonyn ' or an antony »- ~ i lt 9 

word processor, perhaps with a drawing *ode which cln bl 

provided as a multi-level set of writina and * 

-e writing and drawing o^xit^^;^ 1 -; 

» -it™ — or teach - a l:: — 

1 1S a ll nk-maker, which offers exerri« e *„ 
of »e.„ri,.tio„. such as paired ass s 
ordered serial learning, and ionics. rL^, ^T"; 
tools can he added to an i.ple»e„t,tio„ J^^tT 

tZl n "* " Udent Pr0j ' C "' « «- y =lopedi, 

such PrOV ' de inS ""« iOT *» °—«=» » t the tools 

can t, added f" — ^.lized tools 

^ be added for ccmercial or industrial training. 
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5.5.2.2. Pile Bvstem Tool 

A general tool preferable in many embodiments is a file 
system with student access. In many instances, including 
elementary education, full view of and access to the system 
5 provided file system can be a disadvantage. Consequently 
this invention contemplates, providing a file system front 
end, or file system tool, that limits the student's view of 
and access to the system file system. This particular tool 
is advantageously implemented as part of the session manager 

10 and not as a material, with that implementation, customized 
iconic file representations are managed as part of the system 
area of the display. 

One embodiment of such a file system tool presents a 
four level file system organized into shelves of books, each 

15 of which has sections, the sections having pages. A book 
representing a directory of files is opened when a student 
user selects its icon. The student navigates around the 
directory book by selecting tabs or by moving page by page, 
by selecting nextpage, lastpage, or other buttons. The 

2 0 student interacts with selected pages, or files, of the book, 
possibly creating new pages and sections. The student can 
also close the book. For most needs of elementary purposes, 
a single shelf with a few pre-specif ied books is adequate. 
More advanced students can be given permission to create and 

2 5 use multiple shelves with new books and to cut and paste 
pages and sections from book to book. A page of a book, a 
file, is preferably presented with the materials that process 
it. For example, user-created text or graphics pages appear 
with the word processor active. Homework and instruction 

30 pages appear with the appropriate materials. 

5.5.2.3. The Scheduler /Calendar Tool 

The schedule/ calendar is an important tool and is 
preferably always present. It is accessed when the ABI 
35 system initiates materials to verify the student is permitted 
and scheduled for this material, and also invoked when the 
system terminates materials to schedule new materials. It is 
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accessed as a global tlmnio „ by ^ ^ 

£rom the student seekin ' sohedu11 "' • 

Further. lt can be directly accessed by the student using the 
calendar tool icon appearing on the student desktop. wh.„ 
» accessed, this tool displays a calendar boo* to the stu^nt 
Viewable in several ways. student, 

data SeCtiOT " eSCri6 ' S ' £ir "' <** schedule/calendar 

data and second, the schedule/calendar processing. Ihe 

schedule/calendar data is a subtype of the school-student 

10 data areas. Optionally, a student's personal schedule cl be 

contamed in the student data object. Generally, this data 

.clothe following fle lds for each ^^^IT 

»a.e of scheduled activity and optionally an identifying 

message; 
Activity priority; 

Deadline date and time, or a definition of a perpetual 
activity, which has periodic requirements but no 
completion date; 
20 Link to material for the activity which in turn can 

specify activity completion criteria; for activity 
of a single student this is typically a particular 
instructional material; for group work activity a 
list of the students for the group and other 
communication information can also be in the 
calendar entry; 

Activity characteristics, for example whether this was 
entered by the student or teacher and whether this 
is to be narked complete by the student or system; 
Activity status, completion status and submission status 
of any required reports. 
This exemplary data, sufficient to define a scheduled 
activity, can alternatively be entered by the teacher or by 

35 Tj tU TT " ente " d ^ ^ t6aCher ' 4t Can be P~*ected 
35 from modification by the student. Data entry i s preferably 

assisted by a teacher tool with a suitable screen format. 
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Optional activities can be encered by the student if the 
teacher permits. 

The schedule/calendar tool can be directed by the 
teacher to permit the student a range of scheduling 
5 initiatives. These initiatives can range from permitting the 
student freedom to schedule materials as desired to requiring 
the schedule/calendar tool to enforce a fixed order of 
student activities. In a preferred embodiment this is 
accomplished by the teacher's specifying initiative 

10 parameters including a deadline date/time, D, and a criterion 
priority, P, in the school-student data. The 
schedule /calendar then schedules automatically all tasks with 
deadline less than or equal to D and with priority level 
greater than or equal to P. By varying D and P with respect 

15 to scheduled tasks the teacher can achieve the specified 
range of initiatives. 

Schedule/calendar processing can be invoked by the 
executive software, by the student, or by the agent. As 
previously described, at the beginning of a student session 

20 or after termination of the use of a particular material, the 
executive software invokes schedule/calendar tool, first, to 
mark the terminated task complete, and then, to reference the 
calendar data in view of the initiative parameters to find 
activities requiring scheduling. If this tool finds only one 

25 activity in the calendar requiring scheduling, this required 
activity is initiated. If multiple required activities are 
found, the tool can, alternately, initiate the required 
activity of highest priority or allow the student a choice of 
which required task to initiate. If there are no required 

30 activities, the schedule/calendar tool allows student 
selection of the next task via the session manager. 

The schedule/ calendar tool can be invoked by the student 
by selecting che schedule /calendar icon in the system area of 
the display. When so invoked, the tool displays the student 

35 calendar and scheduled activities in various formats from a 
monthly overview to details of individual activities. If 
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Tne schedule/calendar tool can also be invoked by the 

s T" " "° eiVe5 ' of the type 

» wnat do I do next^ M The . . . 

o next. The agent retrieves the required and 

scheduled activities from this tool and also dete J nes an 

expected time to complete each tas* based on student 

performance from the student data object and the average time 
required for each tasR fron ^ Mter . ais 9 t^e 

XO this coined information, the agent can present to the 

student an ordered list of activities scheduled according to 
their expected time to complete. 



5.5.2.4 

15 



c ommunication* Tool. ,nd G r oup t ort ^.., 1h 

in a preferred embodiment, the AM system includes 
communication, or group worK, materials integrated with the 
remainder of the system. As for other tools and material 
access to communications materials is granted by the 
scheduler/calendar tool. Communication work groups are 
20 assigned and scheduled in students' calendars with calendar 
entries preferably including the group members names and 
other communication parameters. When these materials are 
activated by the scheduler, the communication group is begun 
Alternatively, students can spontaneously request the 
25 formation of a communication group by the selection of a 
communication material. The scheduler/ calendar tool can 
permit group activation if the students have no other 
required activities. Alternatively, each particular 

30 ^r Bl r i ° B B3terial ^ alS ° ^ SPSCifiC aC « SS «»*rol. 
30 preferably set by the teacher that control the types of 

communication permitted and with whom the communications is 
permitted. 

in manner similar to other tools and materials, the 
communication materials have an agent interface, upon 
35 activation, they send initialization event messages to the 
agent specifying the global control variables they will be 
sensitive to, the educational paradigm- adopted, and available 
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hints, helps, and other communication parameters. In 
alternative embodiments, the instructional materials 
interface standards include special categories for 
communication based work that enable the agent to control 
5 these materials with specificity. During communication work, 
these materials generate event messages at educationally 
significant points. 

Thereby, communication materials are fully integrated 
into an ABI embodiment. Further, in a -preferred embodiment, 

10 communication materials are implemented in a manner similar 
to other materials. First, each communication material has a 
particular communication task specific for that communication 
material or form of group work. The communication task 
manages the network interface for that particular type of 

15 communication or group activity by using the network 
protocols provided by the OS and ES, and provides its 
communication functions as global functions for access 
through an ABI system. Second, these functions are made 
available to the student in a manner similar to other 

20 materials through particular materials data that includes 

presentation items, sequencing logic referencing these global 
communication functions, and notations generating event 
messages for the agent. In an alternative embodiment, the 
communication materials can be programs, independent of the 

25 materials engine and perhaps part of the associated 

communication task, which internally generate the necessary 
agent event messages. In either embodiment, communication 
materials tasks can be written either in the ABI 
implementation languages, or in a special purpose 

30 communication scripting language. 

The particular communication materials in a preferred 
embodiment provide forms of group work or communication 
including e-mail or message exchange, linking student groups 
for joint work on materials, and structured joint work such 

35 as contests with rules. Each of these forms of group work or 
communication is described in the remainder of this section. 
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..terms'" TZT T P »** * =°-unication 

eternals 1S E - Bail and „e„ S groups. 

te.ch.rs to send initio to their cL.se. 721 J 
schedule end .aterials changes and to ccunicate vitn „ 
s students. Sobers M „ also ejtehange « - « absent 

other or obtain heip for sysf and ot h. r issue.. s t „de nt * 
=« use this for* to obtain h. lp and advice, especial frl 

i z::z" s \ comma * ic ' te uith their *—» ' - 

work or interests with other students E- mJ ,ii a ^ 

10 ~ -r inc — - --oust-di™"™::" 0 " 5 

ferial, data is authored that grants aces to these 
functions and generates appropriate agent .vent ...sages 
Student linking is a „ otner tm gf 

i.plement M by ccunication materials, students in • 
» at s.p.r.t. clients can link toother for various ZZZT 
activities including si.ply talking „i t „ each ot .r bT e 

the r„°7° r j ° lnt ^ * * Pa " iCUl " "hich 
the student, have either si.ilar roles, as in developing a 

docu».„t using a word processor, or different role, as in a 

ZTT ion or Another * ctivity «* *~ 

. elude, group activities, in which position of participants 
within a virtual e„viron.ent determine, activity and role 
sZZ Y : * "" al eXe " P1 ^ for li„ki„, 

» Is co„troIL U d PB b 1S °° d,r "" 1 " CtiVity - in " hlCh P^icipltion 
is controlled by a special coordinating ta.k that perhaps 

executes on a server sy S t«,. to . X a mp i e of this Utter 
•ct^ty i. a .pellin, bee which is described in .ore detail 
subsequently. aetail 

30 the ,"? 1 the PCeferred enbod i»«nt, student linking includes 
30 the following steps. The first step is identification of 

ITJTT*: ^ Wh ° n 3 giV6n 5tUdent Can »«*■ «« ^ou P 
f" by teacher - the schedule/calendar entry 

for this activity, or alternatively, in a co^unication 
access control particular to this linked work activity. 

T ^ 6Stablished bet — ^e students to be 

L^als t ! UnkS be t0 3 Sin9le — «— niction 
materials task that receives and distributes messages 
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Third, local and global actions must be determined. Local 
actions are those that result in output visible only to the 
user taking the action* Global actions are those that result 
in output visible to all the students in the linked group. 
5 These global actions can include communicating each student's 
input to all linked students, sharing information among all 
linked students, jointly creating information by students in 
the linked group, and storing jointly created information. 
The fourth step in linking is orderly disconnection from the 
10 linked group. 

Linking can be implemented in alternative fashions. in 
all implementations the communications tools and materials 
for linked activities are integrated with the other 
components of an ABI system in one of the ways previously 

15 described. A simple implementation is to provide on each 
student's screen an icon and a message area for each linked 
student. Alternatively, one or more shared materials areas 
can be provided. Communication can be distributed through a 
single server task to which all linked students -connect . A 

20 more advanced implementation of linking employs software 
packages similar to multi-user dungeons ("MUDs"), which 
contain a collection of virtual shared traversable spaces 
(called "rooms") in which users can interact either with each 
other or with elements within the room. MUDs are especially 

25 preferable for student group work in which different students 
have different roles with access to different system 
capabilities. For example, one student can be a recorder, 
having write-access to the group's notebook, while another 
can be the database expert, having access to a body of 

30 relevant data. MUDs are also be useful for teachers, 

communicating with each other within 'rooms' each set aside 
for a specific topic and forming a dynamic newsgroup. 

Another form of group work implemented by communication 
materials is structured linking. Important examples of 

35 structured linking in which the students have different or 
structured roles are educational contests. Exemplary of such 
contests is a spelling bee, an exemplary embodiment of which 
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is described herein. In this embodiment, the spelling bee i« 
managed by a server communication materials task, called the" 
server spelling bee task, which preferably is executed on a 
server system, which communicates with local spelling bee 
5 tasks on the involved students' client system. Generally 
the server spelling bee task initiates a spelling bee by ' 
accumulating connections with students local spelling bee 
tasks, then mediates the spelling bee by controlling student 
actions, and provides for orderly termination of the spelling 
10 bee. The local spelling bee tasks provide the communication 
functions accessed or required by the spelling bee materials 
data, which are scheduled or selected to invoke spelling bee 
participation, on the client systems. These materials also 
send event messages to the agent and are controlled by the 
15 student's agent. Alternately, the local spelling bee tasks 
can be programmed to communicate with the agent and perform 
the spelling bee without materials data. 

In more detail, the spelling bee tasks carry out the 
following steps. The spelling bee server task is started at 
2 0 a teacher's request or automatically by the system, a list 
of eligible students can be selected by the teacher or 
automatically determined by the server task based on data in 
the student data objects, including class membership and a 
stated interest in spelling bees. The spelling bee activity 
25 can be scheduled for each individual student by the teacher 
or selected by the student. If a student desires to enter 
the spelling bee, the local spelling bee task is started by 
the ES and a message is returned to the server. No response 
within a specified amount of time is taken as indicating a 
30 desire not to join. If a student's data object shows that 
this is the first time in a spelling bee, an instructional 
and warm-up sequence can be authorized for the student by the 
agent in the server task. If enough eligible students join 
the spelling bee, the server task continues, otherwise it 
35 sends a termination message to those who have joined and 
terminates. Each local spelling bee task obtains space on 
the student display indicating the other players and their 
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inputs. Next the spelling bee begins, and the server task 
broadcasts the word to be spelled selected from a graded word 
list and the name of user to spell the word. Each local task 
echoes the word sent, preferably by requesting the on-screen 
5 agent voice the words as utterances with an appropriate 
affect. The spelling bee materials inform the student's 
local agent of the student's progress and performance in the 
spelling bee materials. The server task accepts input from 
designated user's local task and broadcasts it. The server 

10 task judges and reports on correctness of completed responses 
and, if incorrect, eliminates the student from further 
spelling requests. As student leave the spelling bee, the 
server task is notified and sends messages to the local tasks 
of continuing players in order to update their work spaces. 

15 In each case the student preferences for further spelling 
bees are checked and preference data in the student data 
object is updated. When only one student remains, the server 
spelling bee task terminates the game and reports results. 

20 5.6. The Agent And The Agent Interface 

The agent is an important component of this invention 
and is further described in this section with reference to 
the student data object, the agent interface, agent 
processing, and agent adaptivity. The agent comprises the 

25 student data object which contains data on the student's 
performance on the various materials and data on the 
student's pedagogic model. Other system components 
preferably have an interface to the agent in order that the 
agent can control the materials and guide the student in a 

30 uniform manner. Agent processing is divided into two phases, 
agent action processing and agent behavior processing. 
Finally, agent adaptivity in the preferred and in alternative 
embodiments is described. 
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5#6 ' 1# gtudant Data oh-} -^ 

One student data object is crPAf^ * 
hot created for each student in 

the ABI system and is a repository of data con. 
student. The student data comprises fixed TT T^ ^ 
5 student as w,n « , • ° mpriSes flxed d ^ta defining the 

Preferably, the student data obiedt is ^ 

system operation, each ele _ t o£ Mf 
» directly or indirectly, through the agent, see^acc" s t ' 
the portable student data object is vaulted and ZZlitL 
•s previously described betore access is granted. ldentlfle<1 

server systems when a student access a client svst.» t 
» this embodiment also, the software validation and *" 

e ld rl lfi °" i0 " U " S ° Mva °t»,.ously performed. ln . ith . r 
embodiment, the student is able to access „. „, ! 
«« provision of instruction from ^L. 
» oth Carti,ir, '^"i-nts of an ABI system, , school or 
» other educational provider can keep student related data i„ 

rr nt a,ta areas - ms i —- 

P^re.s T\' " 1C °° UrSe « """ional 

progress data, school schedules etc < 

accord with the school's data retln^on and in 
30 School-stud.™*- a - retention and privacy policies. 

the lae't T " ^ neSSa * es generated by 

the agent and sent to school server systems. Also the . 

this — -~ - - — r^r' 

studZ V reSP ° nSe t0 SChedUlin ^ ^ta-queries from the 
3S caTbe st In / lternatiVe «* school-student data 

adln! " StUd6nt ^ ° bjeCt - This c« be 

advantageous when the student is associated with only one 
school, as in primary or secondary education 
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For compactness of description and not by way of 
limitation, the following description of the content and 
operation of the student data object is according to such 
alternative embodiments. In the accompanying figures, data 
5 subtypes or fields that can be stored in school-student areas 
in appropriate embodiments is suffixed with "(S)." Data 
subtypes and fields that are preferably part of the student 
data object in all embodiments are suffixed with " {A). M In 
this subsection, this latter data is termed agent-specific 

10 data as it is closely related to the agent student model and 
agent processing. 

Figs. 10A, 10B and 11 illustrate the structure and 
operation of the student data object. Figs. 10A and iob 
conceptually illustrates an exemplary structure for student 

15 data object 1101, optionally containing school-student data 
as indicated. It is an object comprising structured data 
1102 and methods 1103 for accessing and updating this data. 
Both agent-specific and school-student data is divided 
generally into global data 1104 , materials related data 1105, 

20 including tool related data 1106, current lesson data 1107, 
and log data 1108. 

Global data, defined to be information meaningful across 
ABI materials, includes such subtypes as system data, agent 
behavior preference data 1109, agent student model data llio, 

25 and schedule data nil. System data includes student 
identifiers, student passwords, access privileges, grade 
levels, class registrations, etc. Such information is 
typically school-student data. Both agent behavior 
preference and agent student model information is agent- 

30 specific data. Agent behavior preference data 1109 relates 
to the multi-modal behaviors generated by the agent and 
includes student defined preferences for these behaviors as 
well as a summary of past agent behaviors. Student 
preferences can include options relating to agent visual 

35 appearance - species, gender, dress, or perhaps, no visual 
appearance - and similar options relating to audio behavior 
and text production. The summary of past agent behaviors is 
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used to aid in the selection of reasonably varied f„t- 
»«lti-,odal saviors. Agent student ^ZT^ 

ZT2 iteBS B ° delin9 ^ StUd6nt ' S P - Sist ^ behavior 
which the agent uses to individualize its int^ a - • 

rate h int effectiveness, and preferr . a rew . Ms 

T.i t:: in an a,ent stua « nt — 1 -» o f 

a student-. ^.Ui^, te«pera»ent , personality sty" and 
" forth. mtelligence .easures can be specified for 

measure, according to th. „ultiple int«Ui,«„ c . s of 
Gardner. Personality style can include inLit!ve/f oI,T 
preferences, such as right br.i„,left brain dominie 
Updates to this data object „de as th. AM c ,i. 

XS «t h the student, and as the s^lZ^^T* 
ao.nt adaptivity to th. student. Pinally, schLul data un 
relate, to assi,„«.„ts s=h.duled by the teacher or 
educational provider and unchangeable by the stud.-, „ • 
typically school-student data. Oat, for' Z^Zl.T^ 

« can ln cl„d. au. dates. re.inder al.„s. and priorities 

has , EiCh COUr " ^ Whi ' ;h StU " ent 15 ="™>«y enrolled 
has a separate .aterials related data area U05 for the 

«t.rials providing instruction in this course, and includes 
both agent-specific and school -student data i„ „„ T 

» e-bodieent. this latter data subtype inches llZlTlT" 
criteria data, usually set by the school system. „hich 
include objectives and standards the student »ust «et in the 
particular course, and .ileston. dat, establishing objectives 
already „t by the student. Such inforeation is cypically 

= . school-student data. motion relating to a student" 
progress, performance, and use of tools is typically agent- 

student to leave the .aterials and resuse the .aterials at 
35 Perforce ' Perf °™ nCe <"» «» "lates to student's 
include mean perfor.ance, weighted .ovin, averages of 
perfor^nce, patterns of perfor»ance, use of hints, us. of 
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retries, and needed remediation. Using such performance 
data, for example, means and weighted moving averages, 
permits the agent to determine whether student performance is 
improving or declining. Tool data 1106 contains essentially 
5 similar but more abbreviated data about use of system tools 
such as the calculator, dictionary, and word processor. This 
data usually includes only milestones and performance 
information. 

For example, in the case of a reading course, agent- 

10 specific data can include reading speed attained, vocabulary 
level achieved, and sentence complexity recognized. 

The status of each lesson presented by instructional 
materials is accumulated in current lesson data 1107, which 
is preferably agent-specific data. This subtype is created 

15 upon lesson initiation and deleted upon lesson completion. 
In an exemplary embodiment, it includes short term measures 
of performance - such as error rates, weighted moving 
averages of error rates, and the use of hints and retries - 
short term measures of time latency - such as time to 

20 complete lesson segments and weighted moving averages of such 
times - work areas in which the agent can store information 
particular to the instructional materials - such as 
parameters to use in forming multimedia presentations - and 
lesson coaching parameters 1113. The lesson coaching 

25 parameters are used by the agent to provide feedback to the 
instructional materials so that their presentation can be 
individualized according to student performance. These 
parameters are governed by the instructional modalities 
employed by the particular instructional materials and can 

30 include values such as the seeding rate of new concepts, time 
pacing of the presentation, the density of examples, and the 
ratio of reinforcement. 

Finally, the student data object has links to student 
log 1108. The log is preferably school-student data stored 

35 on server systems outside of the student data object, it is 
updated by messages generated by data object update methods 
called by the agent. Subject to school data retention and 
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Privacy poiicies, the lo, can store an „ess„es input to 
Jnt processing and ,11 actions fro. agent benav oT 
proc.ssmg. Preferably. this ™ 



It is 



e - -w^o, ana parents. 

5 also of use to instructional materials authors and 
educational researchers, who can use the defied 
student behavior and system responses * ^ £ ' . 
order to improve instructional materials or to deve op Zl 
modalities of instruction. develop new 

10 With its carefully partitioned and functionally defined 

xnterfaces, the ABI system is easily adaptable to new 
modalities of instruction as well as to merely instil ■ 
materials. »erexy installing new 

The student data object also includes access data 
» updating methods, and data guery methods. The methods are 

::": s ble data ° b3ect ana vaiid "° - so . Prior 

tc its generating any student data object requests. An 
ex.^1 u^^, ^ inoiudes ^ ^ * ^» 

trigg.nn, event type m3 and action list me when , 
validated and identified syste. cogent bests' „ 

sends a""' " " StUd * nt 

set=h^ to" r : leVant »"»i„, .ethods are 

" lth * tri ^ in ' «« type which 

Z « • ' ° atehi °' ^ *» «"« —«ed by 

perform, .„ sctlons in ^ V 

the parameters in the update event ..s,.,.. Bach action uses 
the s upplled par „ eters to update ^ eiMMt5 ^ 

student «M«t. Pr e ii»i n , r y to „ v upda 

35 advantageous for the update .ethods to execute rules to 
ensure the update is generally re.son.bU, by, £ or exanple, 
not occurnn, too frequently, a plurality of actions is 
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generally associated with each method because it is typical 
for one event to cause changes in several student model data 
elements. For example, an update event related to the use of 
a tool causes changes in the relevant tool data subtype as 
5 well as the associated instructional material subtype* 
Further, when a lesson is completed, the methods executed 
appropriately summarize student data from the current lesson 
subtype into all the permanent data subtypes. 

For a further example, at lesson completion parameters 

10 such as 'hint effectiveness' in the agent student model data 
1110 are also updated. The 'hint effectiveness' parameter is 
accessed for uses including agent decision weighting, one of 
the methods associated with the event type 'end of lesson' 
updates the parameter 'hint effectiveness' in the following 

15 exemplary manner. The performance parameter 1120 'use of 
hints' is accessed to determine if update is required. If 
hints were provided to the student, the 'current lesson log' 
1108 is used in calculating the two components of the 
parameter 'hint effectiveness' - 'hint ef f ectiveness-bef ore- 

20 first-try' and 'hint effectiveness-after-first-try'. These 
two components each hold an array of values which are used to 
compute a weighted moving average. In an alternative 
embodiment, a more complex formulation of this parameter can 
be used to provide a more detailed analysis of hint 

25 effectiveness - each of its two components can be separated 
into sub-components corresponding to subject area, hint types 
and other instructional ly useful measures. 

It is further preferable, for data elements comparing a 
particular student to class peers according to various 

30 measures be entered into the student data object. This can 
be done by the agent executing appropriate student data 
object update methods in response to messages containing such 
student comparisons generated from school-student data on 
school server systems. 

35 Fig. 11 is an exemplary illustration of how a typical 

student action event updates the student data object. Update 
message 1201 is sent 1206 to the student data object from a 
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associate! "exercise.done" and exemplary 

associated parameters are as indicated at 1202 m rL 

»et h od 1203 with triggering event type 1 s zzv* se 

L e It u Tt by perforning the four associated 

n UPdateS " leVant data elenents - tool data 
subtype 1106 . The second action updates the log 110 e 1 
preferably, sending to server systems an inf V 
descrihin« fK' systems an information message 

The actit »> "»ing latency data 

elements 1205 in current lesson subtype U0 7 
fourth action updates student ^ ^ £ - « 

m current lesson subtype 1107. * •■exits 1204 

A validated and identified component of th» la , 
» to determine the value of pL^ls' d«a system 

the student data object does so 

t the student data object revesting the desired 12 
element. The inwiry Mthoi f „ ^ ^ 

queries are performed directly by inquiry and report 
generating programs. 
« Further aspects of student data object operation i„~, * 

backup of portable student data objected st^ da a 
object initialization. For reliable security and integrity 
especially in case of loss or physical da.,,., lt 

» oTr^r t port * bie stua,nt ° bj «=" *• »p 

ZL ^ FUrther ' " " >™*™>»Y that such 

backup preserve the privacy of information in the portable 
student data object. Accordingly, in the case of portab e 
«-» such as hard or floppy disks, a copy of the already 
encrypted data is sent to the backup system for storage In 
» the case o, smart-card-like portable media, an interface ca" 
be proved which causes the stored data to be exter ^ 
as an encrypted stream for backup storage. Backup are 
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preferably performed with sufficient granularity, such as at 
educationally significant events and at local session 
termination. Centrally stored student data objects are 
backed up according to the facilities of the object-oriented 
5 database in which they are stored. 

Further, it is advantageous that a new student data 
object be initialized. Thereby, instructional materials 'can 
have the advantage of an agent already knowledgeable about 
the student, and the time consuming and perhaps tedious 

10 process of initial agent model construction can be greatly 
shortened. During instruction, the initial model is refined 
and sharpened as previously described. Such initialization 
can be performed in numerous ways. First, the student 
personally, or a teacher, parent, or other knowledgeable 

15 person for the student, can directly enter estimates of 

parameters used in the agent's pedagogic or cognitive model 
of the student. Second, model parameters can be derived from 
tests administered to the student prior to any instruction. 
Such tests can include those specially created for student 

2 0 data object initialization as well as standard tests of a 
student's abilities. These latter include IQ tests for 
student abilities, ABLE"* tests for adult abilities, Thorndike 
Tests of Temperament (TDOT™) for personality profiles, and so 
forth. Specific IQ tests to which this invention is 

25 adaptable include the Stanf ord-Binet w and the Wechsler™ 
tests. 

Specific initialization can optionally be provided for 
certain specific student data object fields. Reading skills 
can be measured and initialized according to one of the many 

30 standard reading and vocabulary tests known in the 

educational arts. Multiple intelligence traits, right 
brain/ left brain dominance, and so forth, can be manually 
initialized by a person who is knowledgeable about the 
student, or who has carried out a personality assessment of 

35 the student. 
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-terlals 5 ^" 6 °' int6rfaCe ^ ^ — the 

materials is important in the ABI system, it permits a 

single agent to control a wide range of materials through 

Z 9Uid6S 3 Sin9le StUd6nt - this by 

advantageously Baintaining a Bodel Qf ^ student - y 

cha racteristics , wh . ch it ^ P W« 

determine its actions. This section, first, describes the 
general procedural structure of this interface, and second 
10 describes the preferred model for the content of the 

interface. This preferred model is structured according to 
^instructional material interface standard (herein called 

Communications between the agent and the materials is 
bi-directional. Events containing parameters are sent to the 
agent by the materials at educationally significant 

contrIir S ', h In reSPOnS8 ' 3gent gl ° bal 

controlling the materials and returns messages confirming 

actions proposed by the materials, in circumstances in which 
20 the materials needs to coordinate displays with the agent It 
communicates synchronously with the agent. Fo r example, when 
the student requests help or a hint, the materials can need 
to synchronously obtain the agent's permission to offer the 
help or hint, m other circumstances, the materials can 
25 asynchronously send informational messages to the agent 
such asynchronous agent input and possible output can give 
the system the appearance of spontaneity. 

The agent/materials interface can be implemented in any 
convenient manner in a given OS. For example, it can be 
30 built on explicit messaging, shared memory areas, procedure 
calls to a socket interface, or other technology. 

The global parameters set by the agent and which control 
the materials are preferably state variables that the 
materials sequencing logic references in order to make 
35 educationally significant sequencing decisions. The meanings 
of state variables to which a particular material is 
sensitive can be established at materials initialization 
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according to specifications in a header materials data entry. 
Examples of such variables range from simple flags, such as 
those controlling the availability of helps and hints, to 
more sophisticated parameters, such as those controlling the 
5 rate of new concept introduction, the density of examples, or 
the speed of discrimination exercises* 

Communications from the materials to the agent are 
controlled by notations in the materials data. A notation 
includes an event type, parameters associated with the event, 

10 and the condition under which the event is constructed and 
sent. Notations are activated when they are encountered in 
sequencing logic in the materials data. There are two 
classes of notations, "point -wise" notations and "toggled" 
notations. Point-wise notations are evaluated exactly once 

15 when they are activated. Toggled notations are evaluated at 
each input event following their activation until they are 
inactivated by a later notation. 

Notations vary according to the materials. Some 
materials, such as simple e-mail, can contain no notations. 

2 0 Tool materials can contain notations indicating only correct 
or incorrect use of the tool. Most instructional materials 
data contain several types of notations. Generally, the 
events generated by these notations send information similar 
to the following: number of retries, measures of rate in 

25 fluency drills, measures of performance such as percent 

correct and the number of tries, partition of exercise items 
into similarity sets, and measures of the relative difficulty 
of items. 

Table 2C illustrates exemplary types of notations 
30 generated by typical instructional materials. 
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TABLE 2C: TYPES OF NOTATIONS 



10 




Help/hint 
request 



At partial answer 
for a requested 
input item 

At complete answer 
for a requesting 
input item 

User request for 
help or hint 



Educational paradigm used; 
meanings of state variahi» c 

Correctness of user input 
time required p ' 

Name of exercise 
difficulty, related 
exercises; correctness of 
user input , time require 

None 




TOQQLED NOTATIONS Z 



Message that agent can 
produce 



Latency 



Inappropriate 
input 



No input event 



25 



Inappropriate 
inputs from student 



Elapsed time, expected type 
of input /H 



Number and type of 
inappropriate inputs 



30 



35 



5621 - Th« Aqant /Material „ T^ rfifii «^^ rT1 

in order that the student's agent can act generally to 

a manner individualized to the student's pedagogic 

InC"r riStiCS ' lt ±S P " ferable that « embodiment of this 
invention use an instructional materials interface standard 

£T« C ! U ' d ■ ACC ° rdi " 5 *° 1MIS - " is Prefera„u 

that the detailed content generated by the notations and 

Passed in messages to the agent be structured in a standard 
fashion according to the particular educational paradigm 
adopted by the materials and independent of the particular 
content of the materials. Further, it is preferable that the 
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materials adopt one of a limited and defined set of 
educational paradigms contemplated in the standard. Finally, 
it is further preferable that the rules referenced by the 
agent in its associated processing tables and performance 
5 data in the student data object be structured according to 
the standards of the IMIS. Thereby, IMIS provides the agent 
with a materials independent view of the student performance. 

IMIS is not limited to a particular set of educational 
paradigms. Any standard set or sets of paradigms appropriate 

10 to the intended students can be adopted for the interface 
standard. It is preferable that the standards adopted be 
based on principles of educational psychology and sound 
educational practice. In the following, this invention is 
described according to an IMIS appropriate for elementary 

15 education. The paradigms described below are not limiting. 

Exemplary educational paradigms 

Exemplary educational paradigms, also known as modes of 
instruction, are listed in Table 3. 



Each of these educational paradigms is preferably 
handled differently by the agent in response to differing 
descriptive information and student performance data. For 
example, a sequence of correct responses in a fluency 
exercise is expected. On the other hand, a sequence of 
correct responses in a paired associates exercise can be 
worth while for the agent to comment on. 



20 



TABLE 3: 



EXEMPLARY EDUCATIONAL PARADIGMS 



25 
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The exemplary embodiment of mis standardizes these 
educational paradigms according to three pieces of 

5 TollT'Z' ^ inStrUCti ° nal the instructional 

format, and most specifically, the subject area. Materials 

alntT S T ld Pref6rably ***^y P"ces for maximum 
agent flexibility, although the AB1 system is adaptable to 
the materials specifying any number or none, if none are 

x. aCti ° nS ^ ^"—^ ° f 

The instructional context is the specific mode of 

Exa^s^f ^7 P T ented t0 ^ StUd6nt * the ° at ~"^ 
Examples of instructional contexts are: 



15 TABLE 4: 



EXEMPLARY INSTRUCTIONAL CONTEXTS 



Prerequisite 
Test 
Review 

Pretest 

20 New material 

Introduction 
Discrimination 
Review 
Practice 

Fluency exercise 
Review 
Unit mastery test 



25 



30 



Within each instructional context, materials can adopt 
instructional formats, the second component of the IMIS 
specification. Examples of instructional formats are- 



35 
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id 



TABLE 5: EXEMPLARY INSTRUCTIONAL FORMATS 



Multiple Choice 
Fill-in-the-blank 

Unprompted 

Selected from list 
Paired Associates 

By letter 

By dragging 

By matching 
Computations 
Simulations 

Identify parts of figures or text 

Simulation games 



Finally, student performance should preferably be stored 
relative to the subject area being worked on, as necessary 
15 for course level reporting. Thus, the third component of the 
exemplary IMIS is the subject area, such as mathematics or 
reading* 

Exemplary standardization of agent data 

20 IMIS standardizes system tables and data relevant to 

agent action processing according to this triple of 
information — instructional context, instructional format, 
subject area — which characterize the education paradigm 
adopted by the materials. The following description 

25 discusses standardization of notations in the materials, 
standardization of data in the student data object, and 
standardization of the agent action processing tables. 

Notations in the materials are standardized according to 
IMIS as follows. For a lesson, exercise, or item, each 

30 material adopts one of the standard set of educational 
paradigms, or modes of instruction. The parameters to be 
passed to the agent in an event message are determined by the 
instructional context and each instructional format of this 
paradigm. 

35 The following table contains an exemplary sequence of 

notations for a "prerequisites review" education paradigm, and 
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the parameters relevant to agent action ^ 

acrion processing that each 

notation sends to the agent. 




Instructional 
Sequence Entry 
Header 



10 



Exercise l Entry 
Header 



15 



Exercise 
Header 



Entry 



TyPe: Pre "<?uisites Review 

Average Time: 5 minutes 
Number of Exercises: e 

Multiple Choice 
Number of Options: 2 
Difficulty: 0.3 
Hint: Available 



Format Type: Fill in Blank 
Subformat: Select from Words in 

Previous Sentence 
Difficulty: 0.5 



20 



An aspect of these notations is to provide information about 
the guaHty of the student response, which, in this example 
« given by the a priori probability of a correct answer ' 
For example, selecting the correct response fro* two choices 
^ has an a prior probability of 0.5 if the choice is made at 
random. Filling in a blank correctly is less likely by 
chance, if no cuing is provided in the exercise 

Advantageously, notations containing the parameters 
associated with a given instructional context and a given 
3e instructional format can be stored as templates i„ libraries. 
Notations are available in these libraries to generate 
necessary messages at materials initialization and during 
materials processing. An instructional designer then need 
only consult these libraries to obtain the notations 
35 appropriate to the educational paradigm of the materials 
being authored. 
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The standardization of the student data object according 
to this exemplary embodiment of IMIS for elementary education 
is simply achieved by storing student performance data 
according to instructional context, instructional format, and 
5 subject area. Thereby, these characteristics can be taken 
into account when comparing student pedagogic performance in 
general across subject matter areas. 

The final component of IMIS standardization is that of 
the agent action processing tables, the policy filter table, 

10 the decision weight table, and the selection rules. Event 
messages from the materials inform the agent of current 
values for the instructional context and instructional 
format. Since these values are parameters available to 
evaluate the conditions and functions contained in these 

15 tables, these tables can be, in effect, segmented into parts 
each corresponding to a particular instructional context and 
instructional format. Since there is considerable overlap 
between the parts of these tables, the number of rules does 
not proliferate. The current subject area is also available 

2 0 to segment the tables in the cases of those subjects that can 

require special treatment by agent action processing. 
Further, the IMIS standardization permits a more systematic 
and effective use of the mechanism which the agent uses to 
set global variables in the materials. These variables 
25 facilitate adaptive adjustments of instructional parameters, 
such as seeding rate and amount of prompting. These 
variables can be more effectively set in view of the current 
educational paradigm as indicated by the current values of 
the instructional context and format. IMIS is also useful in 

3 0 providing information to the student in response to "Where am 

I?" inquiries. The system can use the information contained 
in the entities in the information triple to respond, "You 
are halfway through the drill and practice on fractions," for 
example. 
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Alternative agent ■■bodi^nf K 1ttd bv IMTfl 

in alternative embodiments of agent action processing 

L seg :: nt h in9 of the poucy fnter - d ec p isi 0 ; : ght 

5 aaent^ T * SimPUfied ' instructiona 

ormat T ^ °' «»*«*. instructional 

format, can be augmented by other techniques from artifi cial 
intelligence. Thus, the customized rules and functions 
contained in the action table can be augmented software 
modules, which extend the agent and are constructed based on 
10 such techniques as production rules systems with rule 

Propagation or neural nets. Such additional modules could 
for example, find complex patterns of student error 
unanticipated by the instructional designer. As additional 
artificial intelligence methods are incorporated into L 

no 9 t e a n t ° ftWare ' materi3lS n ° tati0nS be ***** e 

notation repertoire. 



5 ' 6 * 3 * Aaent Ac tion Proe...^^ 

Agent processing is divided into agent action 

20 ZZH^' «-«~» ^ display actions 

in response to input events, and agent behavior processing, 
which transforms display actions into displays to the 
student m a preferred embodiment, agent action processing 

ie based. This and the succeeding section describe the 
preferred embodiments of these divisions of agent processing. 

Fig. 8 illustrates in more detail agent action 
processing. This processing is activated when event messages 
801, representing either input events sent from the l/o 

30 handlers or educationally meaningful messages from the 

aerials, are sent to the agent software, it transforms the 
input event messages into lists of display actions that 
activate the agent display and also has the important side 
effects of updating student data object 806, as indicated by 

35 arrow 815, and of setting materials control parameters, as 
indicated by arrow 816. it is possible a particular input 
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event can generate all or none of these outputs and side 
effects. 

Agent action processing proceeds through three steps: 
event filtering, candidate action weighting, and display 
5 action selection. In common, each of these steps references 
rules in an associated table of rules. These rules include 
relations, functions, and procedures, all of which reference 
input parameters. Input parameters can be any appropriate 
data carried in the input event message and any appropriate 

10 data stored in student data object 806. In particular, as 
indicated by arrow 815, fields from the following subtypes in 
the student data model are referenced: the current lesson 
subtype, the materials specific subtypes, and the agent 
pedagogic student model subtype. In alternative embodiments 

15 where the agent interface and data is structured according to 
an IMIS standard, event input parameters include parameters 
characterizing the current educational paradigm adopted by 
the materials. These parameters can be used to select rules 
applicable only to this paradigm for reference and 

20 activation. 

Turning now to the steps of agent action processing, the 
first step is event filtering 807, referencing policy filter 
table 803. This step is described with reference to Table 7, 
an exemplary policy filter table. 
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TABLE 7: POLICY FILTER TABLE 




15 The first row illustrates a generic policy f ilt er rul. 
subsequent rows illustrate exemplary filter rules The 
generxc rule has a condition and a consequent "he Tol ;- 
xs Boolean expression, B () , of one or mor^ 

*0 IT ?! Wh±Ch iS 3 fUnCti ° n ° f «" mailable paramos 
Default parameters in a rule can be overwritten bv «. 
from th e input event. The consequent is a list % ZTT 

action type, ."tvne »n » * 2. f an agent 

iv , i:ype, an agent action subtype, "sunt™* « . ^ 
zero or more parameters x_ - subtype," and 

, 5:r for ^ - .r n ,r ul rr:ur t : f a „ d 

. rate - The Parameters provide additional 

«iTr :° b * us ' d in — ~«- « « t . ranc :: n L 

30 in , teB * Each rule can be marked active or 

nitialization or as a result of selection according to IM IS 
educational paradio* parameters . Processino a filter r „" 

onsequent ana its para.et.rs into the list of candidate 
-ions. The list of candidate actions is tj^^l to 
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action weighing 808, the next processing step. Also in the 
student data object, the current lesson subtype and materials 
specific data subtype are updated, if necessary, with data 
from the input event message. For example, upon item 
5 completion, performance results need to be updated. 

Action weighting 808 references decision weight table 
804 and assigns a numeric weight to each action in the input 
candidate action list. This step is described with reference 
to Table 8 an exemplary decision weight table. 

10 

TABLE 8: DECISION WEIGHT TABLE 



15 





DECISION WEIGHT TABLE 


Active 


Rule 


Y 


(type, subtype) , weight function(x,, x., . x_) 






Y 


(congratulation, dif f ) , weight function j(Y.,Y.,Y,) 


Y 


(congratulation, done), weightf unction k(Z,,Z.) 



20 

The first row illustrates a generic policy filter rule, while 
subsequent rows illustrate exemplary filter rules. The 
generic rule has an index and a weight function. The index 
is a type and subtype pair, and the consequent is a weight 



25 function of zero or more parameters, x_, with a value between 
0 and 1. Each rule can also be marked active or inactive, 
possibly as a result of selection during materials 
initialization or as a result of selection according to IMIS 
educational paradigm parameters. Processing the list of 

30 candidate actions consists of, for each candidate action, 
selecting the weighting rules that have a type and a subtype 
matching that of the action and then assigning a relative 
priority between zero and one to the action as determined by 
applying the weight function to the available parameters. In 

35 this manner all the candidate actions on the candidate action 
list are assigned a numerical weight. The list of weighted 
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candies actions is then passed on to action selection 809 
the last processing step. 

Action section 809 references selection criteria table 

5 III ! ! Ct 3 f " al ° f aCti ° nS fr ° B the in P«t candidate 
action list. This step is described with reference to Table 
9, an exemplary selection criteria table. 



TABLE 9: SELECTION CRITERIA TABLE 




25 



The selection criteria table consists of a list of available 
methods for the candidate action selection process, a 
20 selection criterion uses the computed weight and perhaps 

other parameters to select one or more final actions from the 
candidate weighted actions. Exemplary selection criteria are 
illustrated in the last two rows, it is anticipated that one 
criteria is marked active as a result of selection during 
materials initialization or as a result of selection 
according to IMIS educational paradigm parameters. The 
active criteria is applied to select zero or more final 
actions, some final actions are executed locally to provide 
control to the materials by setting control parameters, as 
30 indicated by arrow 816. other final actions can cause update 
of fields on the student data object, in particular in the 
agent pedagogic model subtype, as indicated by arrow 815 
The remaining final actions are display actions which are 
passed to agent behavior processing in display action list 
802. The student data object is updated to record the 
selected display actions. 



35 
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Action processing is illustrated with reference to the 
exemplary rules in Tables 7, 8, and 9 by considering the 
results of processing two input events, one of type "item 
done" with a "difficulty greater that LIM" and one of type 
5 "exercise done." Applying the exemplary filter rules from 
Table 7 results in two candidate actions, one being 
(congratulation, diff) and the other being (congratulations, 
done) . No other exemplary boolean expression evaluates to 
true. Next the exemplary weighting rules' from Table 8 are 

10 simply applied by selecting and evaluating the correct 

weighting function. The resulting exemplary candidate action 
weights are taken to be 0*8 for (congratulation, diff ) and 
0.5 for (congratulations, done). Finally, the one active 
exemplary selection rule from Table 9 is applied which 

15 selects the one final action (congratulation, diff) . 

The preferred embodiment here illustrated involved no 
rule propagation. In alternative embodiments more 
sophisticated artificial intelligence programming techniques 
could be employed as is apparent to those of skill in the 

20 art. For example, rule propagation and general production 
rule systems could be used to transform events to actions. 
Other applicable techniques could involve neural nets, 
predicate logic, and so forth. 

25 5.6.4. Agent Bahavior Processing 

Agent behavior processing transforms display actions 
into output displays to the student. In a preferred 
embodiment, agent behavior processing selects from tables of 
possible display behaviors based on the input display action 

30 list and its parameters and on fields in the student data 
object describing student preferences and recent agent 
display behaviors. Further, in a preferred embodiment, agent 
behavior processing generates either display scripts which 
are sent to the I/O handler, or scripts with associated data 

35 snips of sound and animation that are embedded in applets. 
In alternative embodiments, intermediate scripts are not used 
and behavior processing generates I/O handler commands in 
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real time. This section describes agent behavior- „ 

<«.t. with respect to the table data ll^Z^ JsZ^T ' 

second, with respect to the processing steps ' 

5 Firstar 117 ' a9ent behaVi ° r proces ""* includes two steps 
5 Fxrst, the message and its emotional affect, which is til 
displayed or spofcen by the on-screen agent cauld he 
"utterance « 1= ..i. «. ., called herein the 

er.no., is selected according to the input display 
actions, second, the utterance and effect ,r, sent to th 
preferred persone object where it is integrated"" a 

;r :::i dispiay - inciudin < ^-"^ ^ 

The display is preferably represented as a script which Is 
then sent to the I/0 handlers. In behavior ^ZIZT the 
elected affect in ,„ ioportant ' th. 

» e "T Cha " C """ S «• **•»* of the utterance. or 
example, ,„ utterance o, a -congratulations- type is 

happy,- i„ c «es of superior . encou „, e . t „ 

e is 0 '!™"' ^ Stl " leSS ^ ™ Perforce. 
The display behavior of the on-scr.en agent, preferably 

other and th. student, is strongly responsiy. to the affect 
Parameter. A s is Known in th. .rts of fil. animation 

resulting images , human and life-lik. guality. such a 

iaportant so that th - — — - - 

Ml syste, engage th. student in order to improve 

selected in the student data object, as , sll as student 
pr.f.r.nc.s for such parameters as affect intensity and 
» prestation. ao.nt behavior processing can present a 

coherent end lif.-li k , i.„. agreeable to the student over 

:e n s e si i :r" ionai s * ssion or ~ ™ — ^1 

" tocts «• associated with and further characterize th. 
3S mt.„t of utterances. They are s.l.ct.d as part of utterance 
,.n.r,tion procssing for us. in visual dispLy gen.^on 
processing, utterance generation processing Z^Z Tll 
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type, subtype, and parameters of the current event as well as 
in the student data object, which contains the agent student 
model, student pedagogic parameters, and recently generated 
behaviors. Therefore, preferably, the selected affect and 
5 generated visual displays are responsive to the student 
pedagogic characteristics or, alternatively, the student 
cognitive style. 

Turning details of utterance generation, utterances and 
associated affect are generated by selecting options from a 

10 hierarchy of tables. This hierarchy, having typically many 
choices for each level, provides variety in agent behavior. 
At the highest level of this hierarchy are the tables of 
utterance templates 908, which are indexed by action type and 
action subtype. Typically, there are many utterance 

15 templates and associated affect for any given action type and 
subtype, and indexing is according to additional parameters 
that occur in action lists and additional parameters of 
student characteristics from the student data object. For 
example, utterances and affects are further selected 

2 0 according to the educational paradigm employed, student grade 
level, and student preferences. 

At the next level of the utterance generation hierarchy 
are tables of named slots, which are parametrized phrases, or 
in other words, functions which use input parameters to 

25 return phrases. Utterance templates contain named slots as 
well as invariable words and sounds. When an utterance 
template is evaluated, slots with the specified name are 
selected from the slot table. Typically, there are many 
slots of a given name, which are further indexed according to 

30 additional action list parameters and user characteristics 
from the student data object. When a slot is selected for 
use in the utterance template, slot parameters are passed 
from the utterance template. Alternative embodiments of this 
invention are adaptable to hierarchies with additional levels 

35 of utterance generation tables or additional types of tables 
at a given level in the hierarchy. 
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Exemplary Table 10 is a small segment of the utterance 
template table for an action type of "congratulations" and an 
action subtype of "performance" and appropriate for a test 
type paradigm. Table 10 illustrates that the student grade 
5 level, obtained from the student data object, is an 

additional indexing parameter for these utterance templates 
Further, each illustrated template includes a slot named 
••performance-streak-slot," with parameters of grade level 
number of problems answered correctly, and total number of 
10 problems. 



TABLE 10: EXEMPLARY UTTERANCE TEMPLATES 



15 



™f ratUlati ° ns ' P er f°rmance, grade=4, "You got 
<perfonnance-streak-slotM, numright. total) > ri 



ight.") 



get^nr^^^a'or^ 0 ^ 6 - " You *" «-"y 



s??e!J atU <no^ nS ' P erforaan <*, grade=8, "Quite a winning 
streak - <perf ormance-streak-slot (8 . numrioht. total) >" 



20 



(congratulations, performance, grade=l2, "A stellar- 
?o^^r^ h ? e "? ing <P6rf 0r * anCe - S ight , 



It is preferable that the utterance template table have a 
large number of utterance templates appropriate to a large 

^ number of educations situations, since the preferable number 
of type and subtype combinations is at least approximately 
500, and since it is preferable to have 10 to 100 responsive 
utterances per pair, a preferable utterance template table 
has at least 25,000 entries. A less preferable table has at 

3o least 5,000 entries and a more preferable table has at least 
50,000 entries, m an embodiment of the invention, less used 
utterances have fewer candidate responsive utterances without 
impairing the image of system spontaneity. Thus this 
invention is adaptable to utterance tables of i, 0 00 entries. 

35 Exemplary Table u is a small segment of the slot table 

for slots named "performance-streak-slot," any of which could 
be employed in the previous templates. The illustrated slots 
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evaluate their input parameters to results in phrases. For 
example the last slot results in the phrase "90 percent" if 
numright is 9 and total is 10. Further , slots can contain a 
condition which controls their applicability. In this 
5 example it is the fifth component of each entry and only the 
first slot has an non-null condition. 



TABLE 11: EXEMPLARY 8LOT ENTRIES 



(performance-streak-slot, 4-12 , numright, 
> 0.8*<total>, "Nearly all") 


total, 


<numright> 


(performance-streak-slot , 8-12 , numright, 
"<numright> out of <total>") 


total, 


nil, 


(performance-streak-slot, 8-12 , numright, 
" 100*<numright>/<total> percent") 


total, 


nil, 



15 

Slots are used to create final, generated utterances with 
considerable variety. Therefore, it is preferable that the 
slot tables have at least the same number of entries as the 
utterance template table. A preferable slot has at least 



20 25,000 entries. A less preferable table has at least 5,000 
entries, and a more preferable table has at least 50,000 
entries. 

The final display of the preferred on-screen agent 
object is generated from Display Behavior Tables 904 with a 

25 similar hierarchical table data structure to that used in 
utterance generation. At the highest level are on-screen 
agent actions which contain a cast of one or more personae. 
At the next level are persona types which the student selects 
once, or at most once per session. At the next level, 

30 associated with each persona type is a library of display 
behaviors indexed by affect. Exemplary affect types include 
the following: sad, objective, pleased, happy, disappointed, 
announce, remind, encourage, reinforce, model, prompt, hint, 
joke, and tutor. Typically, each affect has many possible 

35 behaviors and these are further indexed, as for utterance 
generation, by parameters appearing in the action list and 
the student data object. The display behaviors are 
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structured as scripts containing named display objects 
These named display objects can optionally involve vo ce 

cti 9 ::^"' or video dispiays ' and they - e in 

5 or a L I ^ ° Ptl ° nally S P ecif V * tiaed animated display 

student 7 dlSPlay ' Wh6re ^ bCanCheS " e on 
student reactions to the display. At the lowest level in the 

Preferred embodiment are the individual named display 

ejects. As for slots, typically there are several 

parametrized instantiations of each named' object. These 

ntiTti 00 :": indexed according to the — ™-s 

indexing the display behaviors and in turn use these 
parameters to generate displays. Alternative embodiments of 
this invention are adaptable to hierarchies with additional 
levels of tables for display generation tables or additional 
" types of tables at a given level in the hierarchy 

Exemplary Table 12 is a small segment with personae 
types adapted to elementary education. 



20 



TABLE 12: EXEMPLARY ON-SCREEN AGENT ACTIONS 



25 



^K^^t^m^ tin, 

& >-Afc««**> — _ . _ 



message. saying the specific part o f the 

3«> It is preferable that the on-screen agent have a richly 

Inc^de and en9a9ing behaVi ° r - ^ PerS ° na typeS Preferably 
include recognizable popular figures as well as a rich 

variety of specially created figures. Persona type tables 

have a preferable selection of at least loo, and less 

preferably at least 50 persona types. The libraries of 

display behaviors preferably have many behaviors for each 

affect. Since the preferable number of. affects is at least 
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50, and since it is preferable to have 50 to 100 responsive 
behaviors per affect, a preferable behavior libraries have at 
least 2,500 entries, and more preferably 5,000 entries, per 
persona type. A fully implemented ABI system can have 
5 preferable behavior libraries with approximately 125,000 
entries. This number can be less in situations were more 
popular persona have fully configured behavior libraries 
while less popular persona have more limited libraries. 
Further, the number of persona types can be advantageously 
10 limited to only the most popular or more appropriate for the 
type of student. Thus this invention is adaptable to 
libraries with approximately 1,000 entries of responsive 
behaviors. 

In implementations of this invention, it is important 

15 that the actual content of the utterance tables and the 
display tables and libraries be sufficiently creative and 
current to engage the student. Therefore, this content is 
preferably created by artists, animators, writers, and other 
creative talent. These elements of sound, voice, animation, 

20 graphics and video are collected into libraries of data snips 
and stored in archives. Further, it is preferable that these 
tables have an extensive and varied content in order that 
agent displays repeat only infrequently. 

Turning now to the process of generating a complete 

25 agent display behavior, the steps of this process are 
described with reference to Fig. 9. The first step is 
utterance generation 906 which receives as input action list 
901. Utterance generation indexes the utterance template 
table in accord with action list parameters, in particular 

30 action type and subtype, and student preferences from the 
student data object, to obtain candidate utterance templates 
responsive to the current situation. If no candidates are 
found, the student preferences are relaxed in a preset order 
until at least one candidate is found. Typically, more than 

35 one candidate is found, and then one template is selected at 
random from among those templates which have not yet been 
used previously in this session. A record of agent display 
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behavior during the session is stored in the student data 
object. The named slots of the selected template are 
resolved in a similar fashion, by finding candidate named 
slots and selecting one at random that has not been recently 
5 used. An utterance is then generated from the template the 
named slot, and the input action list parameters. This' 
utterance and its associated affect is passed to visual 
display generation. 

The second step of agent behavior processing, visual 
10 display generation 907, uses the input utterance and 

associated affect to select candidate responsive displays of 
that affect from the libraries associated with the student's 
current persona (e) preference contained in the student data 
object 905. as with utterance generation, if no candidate is 
15 found, student preferences are relaxed until one is found 
Typically, more than one is found, and one is selected 
randomly avoiding recent selections in this session. Display 
objects referenced in the selected display are similarlv 
found. Finally, the utterance message is sent to the 
20 selected display and display objects. These objects contain 
performance methods that are called to generate and output 
display script, in a preferred embodiment, the script with 
references to data snips 909 of voice, sound, graphics, video 
and animation is incorporated into an applet. An exemplary 
applet can be a program fragment representing a character 
scratching his head while saying the utterance and moving 
across the screen. This output applet is sent to the i/o 
handlers in the ES for student display 908. since this 
completes agent processing for this student or timer event 
30 the system then waits for the next action at wait point 902. 
A display action can also reference a pre-formatted 
animated seguence stored in the data snip library 909 in 
which voice, sound, graphics, animation and video have been 
already integrated, in this case, portions of utterance 
35 processing 906 and visual display processing 907 can be 
bypassed. 
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In alternative embodiments, selection of utterance or 
persona candidates from the available contents can be done 
other than randomly. For example, agent behavior data saved 
during a session in the student data object can be used to 
5 construct performances extending across instances of student 
actions. In particular, utterance templates and display 
objects can be selected in a connected manner in order to 
give agent display the appearance of continuity and realism. 
This invention is adaptable to other methods of generating 
10 performances parametrized by affect and utterance that are 
known in the art. These methods can include advanced text to 
speech techniques, 2-D and 3-D graphical generation, and VR 
effects. 

The visualization of agent actions can involve a single 
15 character or several characters interacting with each other. 
If multiple characters are used, they are preferably 
interrelated. A typical cast is a cat with a bird sidekick. 
An exemplary interaction of these associated characters 
involving both dialogue and movement is presented in Table 
20 12. 

Continuing story line scripts can be available from the 
ABI system on a daily basis in a manner similar to a 
continuing plot in a daily comic strip. These story lines 
can be applicable to a group of. students and individualized 

25 where appropriate. In some cases the student's selected 

persona can introduce a story line and in other cases several 
personae are directly involved in an interaction. For 
example, the story line can be used as the basis for a reward 
such as "We're off to the beach to play volleyball. Join us 

30 when you finish your homework, then later help us solve the 
mystery of the vanishing lake." 

In summary, the use of the student data object in agent 
behavior processing is illustrated in Table 13. 



35 
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TABLE STODENT DATA 08B IN AGENT BEHAVIOR 




Display persona, includina 
type of character, voice 
inflection, activity JSe 
and so forth y e ' 





10 



|^ious utterances in this 

Selection of diff eren t 
display and d isplay ob-i^ g 

Particular data in the student data obiect h a <= 

role in deterainin, ag ent display 7™ 

20 appropriateness, varietv („-• ^ 

, ^riety, and individualization. 

5 * 6 * 5 - Aq»nt Adapt iv4»y 
The adaptation of the a<i.nt to th. student and fh ..r 
systems a P pe ar ,„ C e as a virtual tutor. e„er,e s fr™ t h 
" :!'" t,S UPa " in ' « **. in th. student data ^ecT Tn th 
preferred e^odi.ent, the agent's Knowledge o, tnTstud.' 
represented oy data in th. student data object T n 
- .he student pedagogic .od.l. „ BiC h stores "eneral 
•".rials i„d.pendent data describing how the student > 

30 «—* P^La : 1 : arns ' 

z:::i7°?T ce data sp * cific c ° 
s,=:e r :":r a ::s:;:i:::„ -„ ^r^. 1 """ 0 " — - 

•-sage, which describe the^ent TZ^Z " 

3s ^—.sr^ ~ data — 

-~ f - student' a. ^ ~ JL^t^ ^ 
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individualizes to the student. This adaptation is maintained 
across sessions with this student. 

In the preferred embodiment, the data referenced and 
updated by the agent are averages or weighted moving 
5 averages, giving more weight to recent than past behavior. 
Thus, the pedagogic model includes, for example, data 
weighted moving averages of the rates that the student learns 
discrimination of a certain complexity. Materials specific 
performance includes, for example, weighted moving averages 

10 of data on the student's response time and response latency. 

In alternative implementations, agent adaptivity to its 
student can occur differently. In one alternative 
embodiment, student model data includes not only averages or 
weighted moving averages, but also data on the statistical 

15 distribution of the parameters involved, such as standard 
deviations, with this data the agent can recognize the 
current situation as "normal" or "abnormal" for this student 
and thereby offer appropriate guidance. Further, this 
statistical data can optionally include correlations between 

20 the agent data, such as between various pedagogic parameters 
and various materials parameters. In this manner, 
educational situations can be classified more finely than 
"normal" or "abnormal" into, for example, "abnormally slow on 
this fluency drill in view of normal progress on other 

25 exercises." In a further embodiment, classification of this 
statistical data can be done by special executable modules in 
the agent based on, for example, statistical classification 
schemes or neural networks. 

In a further alternative embodiment, agent action 

30 processing can be implemented with more complicated 
techniques. In the preferred embodiment, agent action 
processing is done by rules without rule propagation. In 
alternative embodiments, rule propagation and full rule based 
systems can be used to transform events into actions. This 

35 invention is applicable to other techniques from artificial 
intelligence that can make. this transformation such as 
Bayesian belief networks. 
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In another alternative embodiment t-ho c + ^ 

suaject area. ., „. u M Tories sports 

leisure ti„. and ot n.r ar . as of Mua intetest =P ° r "; 

„ ««. categories can te entered iB seve^ner, " 

~ u ~;~:er ::; s r r — 

nterest xn materials can inquired for when the materials 

h« ei r^n inv * ntion in adaition « **°» —en*- 

herein Ulll h,. apparent to those 

3. Mifxctio,. ,r. intended t0 £all „ lthin * 
appended clai.s. ^ he 

vhich are incorporated by reference in their entireties. 



35 
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WHAT IS CLAIMED IS: 

1. A method of operating an agent based instruction 
5 system for interactive instruction of a student over a 

plurality of instructional sessions, said method comprising: 

(a) presenting interactive instruction to said 
student by executing one or more materials on a computer 
accessed by said student for a current instructional session; 
10 (b) monitoring said interactive instruction of 

said student during said current instructional session; 

(c) storing information responsive to said 
monitoring of said student during said current instructional 
session for use during subsequent instructional sessions; and 
15 (d) outputting information on said computer to 

guide said student in said interactive instruction, said 
output information responsive to said monitoring of said 
student during said current instructional session and to said 
stored information responsive to said monitoring of said 
2 0 student during previous instructional sessions ; 

whereby said system acts as a virtual tutor adapted 
to said student, said virtual tutor for guiding said 
interactive instruction of said student. 

25 2. The method according to claim 1 further comprising 

after said step of monitoring a further step of controlling 
said one or more materials, said controlling responsive to 
said monitoring of said student during said current 
instructional session and to said stored information 

30 responsive to said monitoring of said student during previous 
instructional sessions, and wherein said one or more 
instructional materials are responsive to said controlling' 
whereby said interactive instruction presented by 
said system is individualized to said student. 

35 

3. The method according to claim 2 wherein said step 
of monitoring further comprises generating monitoring 
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information and storing said monitoring information in a 
student data object. 

4. The method according to claim 2 wherein said step 
5 of monitoring further comprises monitoring pedagogic 

characteristics of said interactive instruction of said 
student by said one or more materials, and said step of 
controlling further comprises controlling said one or more 

10 in ° rder t0 P " Sent interactive instruction with 

io saxd pedagogic characteristics. 

5. The method according to claim 4 wherein said 
pedagogic characteristics are selected from the group 
comprising time pacing of interactive instruction new 

15 ^r 1 " 9 rate ' density of exanpies ' and — — 



6. The method according to claim 2 wherein said step 
of monitoring further comprises monitoring according to an 

20 instructional context and an instructional format adopted by 
each of said one or more materials. 

7. The method according to claim 2 further comprising 
before said step of controlling and said step of outputting a 

25 further step of generating at least one action responsive to 
said monitoring of said student during said current 
instructional session and to said stored information 
responsive to said monitoring of said student during previous 
instructional sessions, and wherein said step of controlling 

30 is responsive to said generated action (s) and wherein said 
step of outputting is responsive to said generated action(s). 

8. The method according to claim 7 wherein said of 
generating step generates action(s) according to one or more 

35 tables of rules. 
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9. The method according to claim 7 wherein said of 
generating step generates action (s) according to one or more 
methods selected from the group of expert systems, neural 
networks, Bayesian belief networks, and statistical pattern 
5 recognition. 

10. The method according to claim 1 wherein said step 
of outputting information further comprises (i) a step of 
selecting an utterance and an affect from one or more 

10 utterance tables in a manner responsive to said monitoring of 
said student during said current instructional session and to 
said stored information responsive to said monitoring of said 
student during previous instructional sessions, and (ii) a 
step of selecting a visual display from one or more tables of 

15 display behaviors in a manner responsive to said utterance, 
said affect, and said monitoring and said stored information. 

11. The method according to claim 10 wherein said step 
of monitoring further comprises monitoring pedagogic 

2 0 information describing the pedagogic characteristics of said 

student, wherein said selected display behavior comprises one 
or more personae, and wherein said selected visual display is 
further responsive to said pedagogic information; 

whereby said one or more personae present a life- 
25 like appearance individualized to said student's cognitive 
style. 

12. The method according to claim 1 further comprising 
prior to said step of outputting a step of inputting at least 

3 0 one request of said student for guidance in said interactive 

instruction, and wherein said output information is further 
responsive to said input requests. 

13. The method according to claim 1 wherein said 
35 computer accessed by said student is one computer of a 

plurality of computers interconnected by a network, and 
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wherein said student can access any of said plurality of 
computers for an instructional session. 

14. The method according to claim i wherein said output 
5 ^formation further comprises an utterance, and wherein the 
step of outputting further comprises a step of selecting said 
utterance from one or more candidate utterances, and a 
further step of outputting said utterance as text or speech. 

« 15. The method according to claim 14 wherein said step 

of selecting further comprises selecting said one or more 
candidate utterance from one or more tables of utterances. 

16. The method according to claim 15 wherein said one 
15 or more table of utterances comprise at least 1,000 

utterances . 

17. The method according to claim 14 wherein said one 
or more candidate utterances comprises at least 10 

20 utterances. 

18. The method according to claim l wherein said 
responsive output information further comprises a display 
behavior, and wherein the step of outputting further 

« comprises a step of selecting said display behavior from one 
or more candidate display behaviors, and a further step of 
outputting said display behavior. 

19. The method according to claim 18 wherein said step 
30 of selecting further comprises selecting one or more 

candidate display behaviors from one or more tables of 
display behaviors. 



20. 



The method according to claim 19 wherein said one 
35 or more tables of display behaviors comprise at least 1,000 
display behaviors. 
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21. The method according to claim 18 wherein said one 
or more candidate display behaviors comprises at least 10 
display behaviors. 

5 22. The method according to claim 18 wherein said step 

of outputting said selected display behavior comprises 
outputting one or more modalities selected from the group 
consisting of text, voice, audio, animation, video, and Pre- 
formatted animated sequences. 

10 

23. The method according to claim 18 wherein said 
selected display behavior comprises one or more persona. 

24. The method according to claim 1 wherein said one or 
15 more materials is a plurality of materials. 

25. The method according to claim 1 wherein said one or 
more students is a plurality of students. 

20 26. The method according to claim 1 wherein said step 

of monitoring further comprises monitoring pedagogic 
information describing the pedagogic characteristics of said 
student in a manner independent of the subject matters of 
said one or more materials. 

25 

27. The method according to claim 1 wherein said step 
of monitoring further comprises monitoring progress and 
performance information describing the progress and 
performance of said student in said interactive instruction 

30 presented by each of said one or more materials. 

28. The method according to claim 1 wherein said step 
of storing further comprises storing said information 
responsive to said monitoring in one of one or more student 

35 data objects, each student data object of said one or more 
student data objects being uniquely associated with exactly 
one student of said one or more students. 
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29. The method according to claim i wherein sain 
»ore materials further comprise a Mt «H . " 1B S3ld one or 
more materials dat* „ T mater "l engine and one or 

materials data, and wherein said sten of „ 
interactive instruction by executing present *"* 
5 further comprises execute CUtlng ° ne or «™ materials 

references Lxd L ? materialS en * in « 

ences said one or more materials data. 

30. The method according to claim 29 
materials data wherein said 

referencing said notation, ^ * materials engine 

y notations m order to generate m™< + 

information. generate monitoring 

-id „et«od co-prisino: °' °"° « — «—«.. 

to access si =^"'0^ T^""' " ~ * ~* 
■ore materials «" "V -"ruction ov on. or 

computer o f a JL, , " "' C °* PU " r beil " «~ 

net!orJ ' ^ —nected by . 

(b) loading to .aid comput.r softwar. ,„ „ 
saw interactive instruction.- ""Mr. and data for 

» computer Jor'prerr"" 5 ™ ° r °" said 

stuL" aL ' tln9 instruction to said on. 

oCV^'l^ 

32. The method according to claim 31 fun-h.^ 
after said sten of further comprising 

3j ^acti,. ZZ^JLl^ZZZr 

3S .onitorin, information that .onitors s.L interactTv. 
instruction of said student, and wner.in said st e p "f 
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outputting information is responsive to said monitoring 
information ; 

whereby said system acts as a virtual tutor adapted 
to said one student, said virtual tutor for guiding said 
5 interactive instruction of said student. 

33. The method according to claim 31 further comprising 
after said monitoring step a further step of controlling said 
one or more materials to present instruction to said student 
10 that is responsive to said monitoring information, whereby 
said interactive instruction presented by said system is 
individualized to said student. 

34. The method according to claim 33 further comprising 
15 after said loading step a further step of maintaining a model 

of said one student, said maintaining responsive to said 
monitoring information of said student, and wherein the step 
of outputting and the step of controlling are further 
responsive to said model of said student, whereby said 
20 outputting step and said controlling step adapt to said 

student thereby individualizing said interactive instruction 
of said student. 

35. The method according. to claim 34 wherein said step 
25 of maintaining a model of said one student further comprises 

storing said model in a student data object. 

36. The method according to claim 3 5 wherein said step 
of checking the authority further checks the authority of 

30 said one student to access said student data object. 

37. The method according to claim 35 further comprising 
a step of validating after said step of loading and prior to 
said step of maintaining, said step of validating validates 

35 said computer software loaded for said interactive 

instruction in order to verify that said loaded computer 
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software is correctly identified as software that- 
maintains said model. °*tware that correctly 

38. The method according to claim 31 wherein «= •„ 

S or »=re Mt er ials compri5e a plurauty JZZZ S ^ ^ 

39. The method according to claim 31 wherein „ 
-re „ s. id plurality of CMputers ar> 

•or. server enters for hcWin, d ataba J °" S °' 

across said network ™P"ses loadxng 

network to said computer from said databases. 

40. The method according to claim 39 wherein said 
- -re™ ^ ™« - - iS demand 

ca^re^^^ : — - — comprising 

2 « 4 2. The method according to claim 31 wherein ■„ 

- -putting information further comprises o t .t nT ^ 
^formation in one or more output modalities. 

43. The method according to claim 42 where 
25 more output modal it-i** a „ ld one or 

cput modalities are one or more output modalities 

selected from the group consisting of text, graphics s Lc h 
audio, animation, video, and P re-f ormatted animated 
sequences. 



30 



44. The method according to claim 42 wherein said 



35 



45. The method according to claim 42 wherein said 
output modalities further comprise content, and said step of 
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outputting information further comprises a step of loading 
said content to said computer. 

46. A method of operating an agent based instruction 
5 system for interactive instruction of one or more students 
over a plurality of instructional sessions, said method 
comprising: 

(a) presenting interactive instruction to one of 
said students by executing one or more materials on a 

10 computer accessed by said student for a current instructional 
session; 

(b) monitoring said interactive instruction of 
said student during said current instructional session; 

(c) storing information responsive to said 

15 monitoring of said student during said current instructional 
session for use during subsequent instructional sessions; 

(d) determining an affect responsive to said 
monitoring of said student during said current instructional 
session and to said stored information responsive to said 

2 0 monitoring of said student during previous instructional 
sessions; and 

(e) outputting information on said computer to 
guide said student in said interactive instruction, said 
output information responsive to said affect, to said 

25 monitoring of said student during said current instructional 
session, and to said stored information responsive to said 
monitoring of said student during previous instructional 
sessions, said output information comprising a visual 
display; 

30 whereby said visual display is responsive to said 

affect and to said interactive instruction in a life-like 
manner . 

47. The method according to claim 46 wherein said step 
35 of monitoring further comprises monitoring pedagogic 
characteristics of said student, and wherein the step of 
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deterging an affect deterinin e S an affect further responsive 
to said pedagogic characteristics; P°nsive 

whereby said visual display is responsive in a 
life-like manner individualized to said student's cognitive 



5 style 



48. The method according to claim 46 wherein said 
output information further comprises an utterance, and 
wherein the step of outputting further comprises a step of 
10 selecting said utterance from one or more tables of 

utterances in a manner responsive to said monitoring and to 
saxd stored information, and a further step of outputting 
said utterance as text or speech; * 

• Utterance and s *i<* visual display are 

15 responsive in a life-like manner. 

49. The method according to claim 46 wherein said step 
of outputting further comprises selecting said visual dl * 
from one or more tables of visual displays in a manner 

20 responsive to said affect, to said monitoring, and to said 
stored information. 

50. The method according to claim 46 wherein said 
^ selected display behavior comprises one or more persona. 

51. An agent based instruction system for interactive 
instruction of one or more students, said system comprising: 

(a) one or more computers having interactive 
input/output devices and interconnected by a network; 
30 (b) one or more aaterials executable on said one 

or more computers, each said material for presenting 
interactive instruction to said one or more students and for 
generating monitoring information that monitors said 
interactive instruction; and 

" (c) one or more agents executable on said one or 

more computers, each said agent associated with exactly one 
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of said students and each said student associated with 
exactly one of said agents, each said agent comprising 

(i) action processing for controlling said 
one or more materials to instruct said associated student, 

5 said controlling being responsive to said monitoring 

information that monitors said interactive instruction of 
said associated student, and 

(ii) behavior processing for outputting 
information to guide said associated student, said outputting 

10 being responsive to said monitoring information that monitors 
said interactive instruction of said associated student; 

whereby said system acts as a virtual tutor to each 
of said students and said interactive instruction of each of 
said students is individualized to each student. 

15 

52. The system according to claim 51 further comprising 
executive software for interfacing said one or more materials 
and said one or more agents to said one or more computers and 
to said network. 

20 

53. The system according to claim 51 wherein said 
network is configured to permit any one of said students to 
access any one of said one or more materials from any one of 
said computers. 

25 

54. The system according to claim 51 wherein said 
network is configured to permit one or more of said computers 
to be located in one or more locations. 

3< > 55. The system according to claim 54 wherein one or 

more of said locations are residences of one or more of said 
students . 

56. The system according to claim 54 wherein one or 
35 more of said materials presents homework to one or more of 
said students. 
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57. The system according to claim 51 wherein said 

„ n ::::::. is further *° » • — 

5 58. The system according to clai» 51 wherein sain , . 

action processing is fu rt„er responsive „ , -« 
Stance f ro» said associated student, and herein sa d agent 
Javier processing is further responsive to said reguest'ror 

10 

59. The system according to claim 58 wherein 

it;:: r processing further c — agent 

I f " It " PrOCeSSi " 9 f ° r sei -ting an utterance ana an 
affect response to said monitoring information or to said 

iT:ii2i 1 ispiay responsive to said - 

60. The system according to claim 59 wherein sai n a - 
*0 behavior processing selects said utterance an ^ d v su i" 
-UPl. y to represent a persona, said selection being from a 
table of available pers0 nas and according. to the preferences 
of said associated student. ererences 

" »t ^i' ^ SySteU aCC ° rding t0 clai » 51 herein said 

on si 1 : fUrth6r C ° BPriSe inSt " Cti -^ -trials executable 
on said computers for interactive instruction of said 
students, and tools executable on said computers for 
^ assistance of said students in said interactive instruction. 

62. The system according to claim 61 wherein said 
instructional materials further comprise instructional 
»aterials appropriate to primary or secondary education. 

further'* Th< \ SySteB acco ^ to claim 61 wherein said tools 
further comprise one or more tools selected from the group 



35 
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comprising a calculator, a dictionary, a thesaurus, an atlas, 
an encyclopedia, and a network search tool. 

64. The system according to claim 61 wherein said tools 
5 further comprise a starfish tool for displaying and selecting 

relationships. 

65. The system according to claim 51 further comprising 
one or more schedule/calendar tools executable on said 

10 computers, each said schedule/ calendar tool associated with 
exactly one of said plurality of students and each said 
student associated with exactly one of said schedule/ calendar 
tools, each said schedule/calendar tools for outputting to 
said associated student information relating to scheduled 

15 activities of said associated student, and for providing to 
said agent of said associated student information relating to 
scheduled activities of said associated student. 

66. The system according to claim 65 further comprising 
20 data areas for each of said students characterizing scheduled 

activities according to deadline date and priority, and 
wherein said schedule/calendar tool further limits said 
associated student to interactive instruction according to 
said data areas characterizing said scheduled activities. 

25 

67. The system according to claim 51 further comprising 
one or more communication tools executable on said computers 
for providing forms of interactive group instruction to a 
group of said students, and for generating monitoring 

30 information that monitors said group instruction of each 
student in said group • 

68. The system according to claim 67 where said forms 
of group instruction are selected from the group consisting 

35 of exchange of messages, group work on a shared material, and 
group participation in educational contests. 
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mor. J'" T SySt6m aCC ° rdin ^ to 51 wherein one or 

*P re of said Aerials further 

software and materials data, and wherein said materials 
engine process said materials data to present said 
5 interactive instruction. 

said J!" SYStem aCC ° rdin ^ to cl "» «» wherein each of 

said materials data further comprises: 

(3) 3 Polity of display objects for 
10 presentation; 

(b) sequencing logic for controlling the order of 
said presentation of said plurality of display\ bj ects and 

ICl nnf a 4* -4 



15 



(c) notations for causing generation of said 
monitoring information. 

71. The system according to claim 51 wherein one or 

::i;r::ti:;:: ateriais — s ■ ™ — - ~ 

20 72 " SyStem aCCOrdin ^ to claim 51 further comprising 

Pedagogic information data areas for each student, said ' 
Pedagogy information data areas comprising data for a 
pedagogxc model of said student, and wherein said agent 

25 furtT PrOC6SSing and Said ^ ^-vior processing is 

25 further responsive to said pedagogic information da!a areas. 

in sai I 3 ' T SySte " aCC ° rding t0 clai » ™ w^rein said data 
in said pedagogy information data areas does not depend on 
the subject matter of said one or more materials. 

30 

action 7 ^ SySte " aCC ° rdin * t0 Clai " 72 said agent 

action processing updates said pedagogic information data 
areas associated with said agent's associated student, said 

35 wSr " g reSp ° nsive to said monitoring information, 

35 whereoy said associated agent adapts to said student 
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75. The system according to claim 72 further comprising 
progress and performance data areas for each student, said 
progress and performance data areas comprising data 
describing progress and performance of each said student in 
5 said interactive instruction, and wherein said agent action 
processing and said agent behavior processing are further 
responsive to said progress and performance information data 
areas. 

10 76 • The system according to claim 75 wherein said agent 

action processing updates said progress and performance data 
areas associated with said associated student of said agent, 
said updating responsive to said monitoring information; 

whereby said associated agent adapts to said 

15 student. 

77. The system according to claim 51 wherein one or 
more of said materials presents said interactive instruction 
according to an education paradigm, and wherein said 

20 monitoring information generated by said materials further 
comprises pedagogic information classified according to said 
education paradigm of said materials . 

78. The system according to claim 77 further comprising 
25 control parameters for each material that have an educational 

paradigm, wherein each material presents said interactive 
instruction according to values of said control parameters, 
and wherein said agent action processing assigns said values 
of said control parameters ; 
30 whereby said agent action processing controls said 

materials* 

79. The system according to claim 77 wherein said 
educational paradigm is selected from the group consisting of 

35 interactive tutorial, fluency exercise, paired association 
exercise, discrimination formation exercise, and simulation 
exercise. 
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80. The system according to claim 77 wherein said 
educational paradigm is standardized according to an 
instructional context and an instructional format. 

5 81. The system according to claim so wherein said 

instructional context is selected from the group consistina 
of Prereguisite test, prereguisite review, ^ f ? 
material introduction, new material discrimination new 
material review, f i uenc y exercise practice, review practice 
10 and unit mastery test. practice, 

82 The system according to claim 80 wherein said 

« alZl IT' f ° raat ^ S6leCted fr ° n 9r ° UP C ° nSisti ^ of 
multiple choice, unprompted f ill-in-the-blank, fiu- in th ! 

X 5 blan, selected from a list, paired associates byiet" 
paired associates by dragging, paired associates by matchinp 
computation, simulation to identify parts of figurls r t ex t 
and simulation game. ' 

20 ac H 83 ' SySten aCC ° rding to clai » 51 wherein said agent 

action processing generates at least one action responsive to 
said monitoring information. 

25 actio " ' ^ SySteB aCC ° rdin * t0 Clai » « herein said agent 
25 action processing further comprises software using one or 

HI " eCh " iqUeS Sel6Cted f «» the group of expert systems, 
neural network, Bayesian belief network, and statistics 
pattern recognition. 

30 85. The system according to claim 83 further comprisina 

a p urality of tables of rules, and wherein said 
processing software further comprises software referencing 
said plurality of tables of rules in order to control said 
one or more materials and to generate said action (s). 

3 5 

86. The system according to claim 85 wherein said 
Plurality of tables of rules comprises a policy filter table, 
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a decision weight table, and a selection criteria table, and 
wherein said agent action processing references said policy 
filter table for determining one or more candidate actions, 
references said decision weight table for ranking said one or 
5 more candidate actions, and references said selection 

criteria table for selecting said action (s) from said ranked 
candidate actions. 

87. The system according to claim 83 wherein said agent 
10 behavior processing is responsive to said action (s) in order 

to output information responsive to said monitoring 
information. 

88. The system according to claim 87 further comprising 
15 a plurality of tables of possible outputs, and wherein said 

agent behavior processing software references said tables of 
possible outputs. 

89. The system according to claim 88 wherein said one 
2 0 or more tables of possible outputs further comprise an 

utterance template table and a display behavior table, and 
wherein said agent behavior processing references said 
utterance template table for selecting an utterance and an 
affect according to said action(s) , and references said 
25 display behavior table for selecting a visual display 

according to said action(s), said utterance, and said affect. 

90. The system according to claim 87 wherein said agent 
behavior processing outputs information in a plurality of 

30 output modalities. 

91. The system according to claim 87 wherein said 
output modalities are one or more output modalities selected 
from the group consisting of text, graphics, speech, audio, 

35 animation, video, and pre-formatted animated sequences. 
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92. The system according to claim 51 further comprisina 
one or more student data objects, each of said student dat" 
ejects associated with exactly one student, and wherein each 
agent stores information reflecting said monitoring 
5 information of said one student associated with said agent in 
said one student data object associated with said associated 
student* 

93. The system according to claim 92 wherein one or 
10 more of said computers are configured as server systems, and 
wherein said student data objects are stored on said server 

systems. er 

15 on. ^ ' ^ SyStSm aCC ° rding to clai * « ^rther comprising 
15 one or more portable media, each said portable media for 
storing one student data object associated with one of said 
students, and wherein said one or more computers are further 
capable of accessing said student data object on said 
portable media. 

20 

95. The system according to claim 94 wherein said 
portable medium for storing said student data object is 
Physically possessed by said one associated student. 

25 96. The system according to claim 94 wherein said 

portable media further comprises a portable hard disk or a 
portable floppy disk. 

97. The system according to claim 96 wherein said 

30 student data object is stored in an encrypted fashion on said 
portable storage media. 

98. The system according to claim 94 wherein said 
portable media further comprises a portable card which 

35 comprises: 

(a) a stable storage for storing said student data 
object; and 
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(b) a processor for responding to calls to access 
said student data object from said one or more computers. 

99. The system according to claim 98 wherein said 
5 portable media is a smart-card. 

100. The system according to claim 92 wherein said 
student data object associated with one student further 
comprises: 

10 (a) pedagogic information describing a pedagogic 

model of said one student; and 

(b) progress and performance information for 
describing the progress and performance of said student in 
said materials. 

15 

101. The system according to claim 100 wherein said 
agent associated with each student further comprises agent 
software and said student data object associated with said 
student, and wherein said agent software references and 

2 0 updates said associated student data object. 

102. The system according to claim 51 wherein one 
or more of said computers are configured as server systems, 
wherein said server systems store said one or more materials 

25 and one or more agents, and wherein said one or more 
computers downloads said materials and said one or more 
agents from said one or more server systems across said 
computer network. 

30 103. The system according to claim 102 further 

comprising databases of pedagogic information and materials 
progress and performance information for said one or more 
students, and wherein said databases are stored on said 
server systems. 

35 

104. The system according to claim 103 further 

comprising reporting software for generating reports from 

- 149 - 



WO 97/44766 

PCT/US97/08685 

said databases of pedagogic information and materials 
stu!"ts S Perf0nnanCe info ™*tion for said one or more 

5 105. The system according to claia si further 

comprising one or more system managers executable on a *id one 
or more computers, wherein said interactive input/output 
devices include a computer display at each of said one or 

io onr c irr ers ' and wherein said systeB * anager «. 

10 one computer partitions said display of said one computer 
into one or more display areas. 

106. The system according to claim 105 wherein said 

one or more display areas are selected from the group 
composing an agent area for agent interactivity, a materials 
area for materials interactivity, and a system area in which 
said system manager displays selection icons for available 
system tools and facilities. 

20 107 . The system according to claim 106 wherein said 

one or more materials and said one or more agents provide 
facilities always available to said one or more students and 
said materxals area and said agent area comprise sub-areas 
whose selection activates one of said always available 

25 facilities. 

108. The system according to claim 106 wherein said 

one or more display areas change in size from time to time. 

30 109, The s y ste * according to claim 51 wherein one 

or more teachers directs instruction of one or more of said 

students, said system further comprising: 

(a) one or more teacher materials executable on 

said one or more computers, each said teacher material for 
35 presenting interactive instruction to teachers in the use of 

said system and in the use of materials directed to said 
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students and for generating monitoring information that 
monitors said interactive instruction; and 

(b) one or more teacher agents executable on said 
one or more computers, each said teacher agent associated 
5 with exactly one of said teachers and each said teacher 
associated with exactly one of said agents, each said agent 
comprising 

(i) action processing for controlling said 
one or more materials to instruct said associated teacher, 

10 said controlling being responsive to said monitoring 

information that monitors said interactive instruction of 
said associated teacher, and 

(ii) behavior processing for outputting 
information to guide said associated teacher, said outputting 

15 being responsive to said monitoring information that monitors 
said interactive instruction of said associated teacher. 

110. An agent based instruction system for 

interactive instruction of one or more students, said system 
20 comprising: 

(a) one or more computers having interactive 
input/ output devices and interconnected by a network; 

(b) one or more materials executable on said one 
or more computers, each said material for presenting 

25 interactive instruction to said one or more students and for 
generating monitoring information that monitors said 
interactive instruction; and 

(c) one or more agents executable on said one or 
more computers, each said agent associated with exactly one 

3 0 of said students and each said student associated with 
exactly one or said agents, each said agent comprising 
(i) utterance generation processing for 
selecting an affect and an utterance to guide said one 
associated student, said selecting of said affect and said 

3 5 utterance being responsive to said monitoring information 
that monitors said interactive instruction of said one 
associated student, and 
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(ii) visual display generation for selecting a 
visual display to guide said one associated student, said 
selecting of said visual display being responsive to ^ 

5 tLT' Sald Utt6ranCe ' and t0 said Altering information 

"i™ said lnteractive instruction ° f — * 

(iii) output processing for outputting to said 
associated student said selected utterance and said selected 
visual display; tea 

« whereby said selected visual display and said 

selected utterance are responsive to said affect and to said 
interactive instruction in a life-like manner. 

111. The system according to claim no wherein said 
15 monitoring information further comprises pedagogic 

information describing the pedagogic characteristics of said 
associated student, and wherein utterance generation 
processing selects an affect further responsive to said 
pedagogic information; 
20 whereby said selected visual display and said 

selected utterance are further responsive in a manner 
individualized to a cognitive style of said associated 
student. 

« 112. The system according to claim 110 wherein said 

utterance generation processing selects said affect and said 
utterance from one or more tables of utterances. 

113. The system according to claim no wherein said 
30 visual display processing selects said visual display from 
one or more tables of visual displays. 

U4. Tne system according to claim no wherein said 
selected visual display comprises one or more persona. 

115. The system according to claim no further 
comprising action processing for generating at least one 



35 
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action and for controlling said one or more materials to 
instruct said associated student, said generating and said 
controlling being responsive to said monitoring information 
that monitors said interactive instruction of said associated 
5 student, and wherein said utterance generation processing and 
said visual display selection processing are further 
responsive to said action (s) * 

116* A method of operating an agent based instruction 
10 system for instruction of a plurality of students, said 
method comprising: 

(a) executing one or more materials on a computer 
for presenting interactive instruction to one student of said 
plurality of students, said computer being one computer of a 

15 plurality of computers interconnected by a network, each 
computer of said plurality having interactive input/output 
devices; 

(b) generating monitoring information that 
monitors said interactive instruction presented to said 

20 student; and 

(c) controlling said one or more materials to 
instruct said student, said controlling being responsive to 
said information monitoring the interactive instruction of 
said student; 

25 whereby said interactive instruction is 

individualized to each student of said plurality of students. 

117. The method according to claim 116 further 
comprising after said step of generating a further step of 
30 outputting information on said computer to guide said student 
in said interactive instruction, said outputting information 
responsive to said monitoring information of said interactive 
instruction of said student; 

whereby said system acts as a virtual tutor adapted 
35 to said student, said virtual tutor for guiding said 
interactive instruction of said student. 
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118. The method according to claim 117 wherein 

119. The method according to claim 117 wherein sai* e * 

: l:;:::" 1 " 9 intorMtion tu " h « — - C t\ r p 

intonation in a plurality of output .odalities 

120. The .ethod according to clai. 11, wher.in said 

10 " r: h " MaUtieS ~ ~ " «~ — «*^ ct ed 

10 fro. the ,roup consisting of text, graphics, speech audio 

an>.atio„, video, and pre-forxatted animated sequences °' 

121. The .ethod according to clai. 117 »h.r.,„ j.-* 
<* outputting infor-ation further comprises U> " " 

IS -lectin, an utterance and an affect . r ' " 

step and (n) a step of selecting a visual disolav t~~ „ 

:. r id* or :t tabies of dispiay b — io " in ■ n" v e t o 

^ said utterance, said affect, and said controning step 

122. The .ethod according to clai. 117 further 
co.prisi„g prior to said outputting step a further step of 
inputting student reguests for guidance in said interactive 

2. is n tr u :: ion - and uher,i " s,ia step °' "~ " 

25 £ »«her responsive to said student revests. 

or J!."' ! he .° eth<>d wording to clai. lis wherein said one 
or .or. .aterials is a pluraUty of material.. 

" 124. The .ethod according to clai. m further 

co.prisi„, prior to said executing step a further step of 
access^, an y one of 3aid by ^ ^ 

accessing co»prisi„, verifying the authority of said one 

3S said » aCC " 8 ^ instruction hy 

35 said one or more materials. 
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125. The method according to claim 124 wherein one or 
more of said computers are located in a plurality of 
locations, and wherein the step of accessing further 
comprises accessing any of said computers in plurality of 

5 locations. 

126. The method according to claim 125 wherein one or 
more of said plurality of locations are residences of one or 
more of said students, and wherein said one or more materials 

10 presents homework in said one or more residences. 

127. The method according to claim 116 wherein said step 
of controlling further comprises controlling according to one 
or more tables of rules. 

15 

128. The method according to claim 127 wherein said one 
or more tables of rules further comprise a policy filter 
table, a decision weight table, and a selection criteria 
table, and wherein said controlling step controls said one or 

2 0 more materials according to one or more determined 

controlling actions, and wherein said controlling step 
references said policy filter table for determining one or 
more candidate controlling actions, references said decision 
weight table for ranking said one or more candidate 

25 controlling actions, and references said selection criteria 
table for selecting one or more controlling actions from said 
ranked candidate controlling actions* 

129. The method according to claim 116 wherein said step 
30 of controlling further comprises controlling according to one 

or more methods selected from the group consisting of expert 
systems, neural networks, Bayesian belief networks, and 
statistical pattern recognition. 

35 130. The method according to claim 116 wherein the step 

of executing further comprises executing one or more of said 
one or more materials according to an educational paradigm, 
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and wherein said monitoring information further comprises 
pedagogic information classified according to said 
educational paradigm adopted by said one or more materials. 

5 131. The method according to claim 130 wherein said 

educational paradigm is standardized according to an 
instructional context and an instructional format. 

132. The method according to claim 116 further 
io comprising after said generating step a further step of 
updatxng one student model of a plurality of student models 
each student of said plurality of students being associated' 
with exactly one student model, said updating being 
responsive to the information monitoring the interactive 
15 instruction of said student, and wherein the step of 
controlling said one or more materials to instruct said 
student is further responsive to said student model of said 
student ; 

whereby said one or more materials are 
20 individualized to said student. 

133. The method according to claim .132 wherein said step 
of updating said one student model further comprises updating 
one of a plurality of student data objects, each said student 

25 data object for storing one of said models. 

134. The method according to claim 133 further 
comprising, prior to said step of executing, a step of 
storing said student data objects on a plurality of portable 

30 storage media, said portable storage being accessible for 
said step of updating, each said portable storage media for 
storing one of said student data objects. 

135. The method according to claim 132 wherein said step 
35 of updating further comprises updating pedagogic information 

in said student model, said pedagogic information describes 
pedagogic characteristics of said student of said plurality 
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of students in a manner independent of the subject matters of 
said one or more materials. 



136* The method according to claim 132 wherein said step 
5 of updating further comprises updating progress and 

performance information in said student model, said progress 
and performance information describes the progress and 
performance of said student in said interactive instruction 
presented by each of said one or more materials. 

10 

137. The method according to claim 116 wherein said one 
or more materials further comprises one or more instructional 
materials for presenting interactive instruction to said 
plurality of students, and one or more tools for presenting 
15 interactive assistance to said plurality of students during 
said interactive instruction. 



138. The method according to claim 116 further 
comprising prior to said controlling step (i) a step of 

20 executing one scheduler/ calendar tools of a plurality of 
scheduler/calendar tools, each student of said plurality of 
students being associated with exactly one scheduler/ calendar 
tool, said one scheduler/ calendar tool providing said student 
with information relating to scheduled activities of said 

25 student, and (ii) a step of generating monitoring information 
that monitors said scheduled activities of said student. 

139. The method according to claim 138 wherein the step 
of executing executes one or more materials that relate to 

30 said scheduled activities of said student. 



140. The method according to claim 116 further 
comprising prior to said controlling step (i) a step of 
executing one or more communication tools for presenting a 
35 or more forms of group instruction to a group of students, 
said group including said student, and (ii) a step of 
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generating monitoring information that monitors said Brn 
instruction of said student. 9r ° Up 



141. A method of operating an agent based instruction 

1TI inStrUCti0 " ° f * *^*y of students, s d 
method comprising: 

(a) a step for executing one or more materials on 
f ° r P ~ Sentin * interactive instruction tTea ch 
student, said computer being one computer of a plurality of 
10 computers interconnected by a netvor*, each compute "J id 
Plurality having interactive input/output devicL; 

that . * St6P generatin * monitoring information 

that monitors said interactive instruction presented to ell 
^ student of said plurality of students; ^ 
15 fc . (C) 3 Ste P for controlling said one or more 
materials to instruct each student, said controlling being 
responsive to said information monitoring the interactive 
instruction of each student; and 

, ft «. „ (d) 3 Step of outputting information to each 

tZ ^ ° rd6r ^ ^ in Said interactive 

instruction, said outputting step responsive to said 

.. . information monitoring the interactive instruction of each 
student and responsive to said controlling step; 

whereby said interactive instruction is 

" and'^tT 1 " 6 " * ^ ° f ° f ^udents 

and acts as a virtual tutor individualized to each student. 

142. An agent based instruction system for instruction 
of a plurality of students, said system comprising: 

(a) means for presenting interactive instruction 
to each student by one or more materials; 

(b) means for generating monitoring information 
student; lt0rS inst ™*i°n presented to each 



35 



(c) means for controlling said one or more 
materials to instruct each student, said controlling being 
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responsive to said information monitoring the interactive 
instruction of each student; and 

(d) means for outputting information to each 
student in order to guide each student in said interactive 
5 instruction, said means for outputting being responsive to 
said information monitoring the interactive instruction of 
each student and responsive to said means for controlling; 

whereby said interactive instruction is 
individualized to each student and said acts as a virtual 
10 tutor individualized to each student, 

143. An agent based instruction system for instruction 
of a student, said system comprising: 

(a) one or more materials executable on a computer 
15 for presenting interactive instruction to said student, said 

computer having interactive input/output devices; and 

(b) an agent executable on said computer, said 
agent (i) receiving monitoring information from each of said 
one or more materials that monitors said interactive 

20 instruction of said student, (ii) controlling said one or 
more materials to instruct said student, said controlling 
being responsive to said monitoring information, and (iii) 
outputting information to guide said student, said outputting 
being responsive to said monitoring information. 

25 

144, A system for agent-based, interactive instruction 
of one or more students over a plurality of instructional 
sessions, said system comprising: 

(a) means for presenting interactive instruction 
30 to one of said students by executing one or more materials on 

a computer accessed by said student for a current 
instructional session; 

(b) means for monitoring said interactive 
instruction of said student during said current instructional 

35 session; 

(c) means for storing information responsive to 
said monitoring of said student during said current 
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instructional session for use durino sub*™ «. • 

sessions; and 9 SUbsequent instructional 

(d) means for outputting information on said 
computer to guide said student in said interactive 
5 instruction, said output information responsive to said 
mentoring of said student during said curr en / 
session and to said stored informal ^Z^^ 
^toring of said student during previous instruc^af 

10 



whereby said system acts as a virtual t„t n . * 

t—t. „« tutor for xzi r aaapted 

mt.ractive instruction of said student, 
sessions, said system comprising: 

to one a , DeanS PreSenting tractive instruction 

to one of said students by executing one or more materials on 
a computer accessed by said student for a current 
20 instructional session; 

(b) means for monitoring said interactive 
L™ 10 " " ~ ^ ^ <™ instructional 

2S«.-„ • Beans for st ""ng infomtion responsive to 

» said monitoring of said student during said current 

se n s S lL U n C S T nal S6SSi0n SUbSe - ent ^ructional 

said BO „> (d) meanS deterDini "9 an affect responsive to 
said monitoring of said student during said current 
30 instructional session and to said stored information 
responsive to said monitoring of said student dur 
instructional sessions; and P S 

(e) means for outputting information on said 
computer to guide said student in said interactive 
instruction, said output information responsive to said 
affect, to said monitoring of said student during said 
current instructional session, and to said stored information 
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responsive to said monitoring of said student during previous 
instructional sessions, said output information comprising a 
visual display; 

whereby said visual display is responsive to said 
5 affect and to said interactive instruction in a life-like 
manner . 

146. A computer readable medium comprising instructions 
for performing the method of claim 1. 

10 

147. A computer readable medium comprising instructions 
for performing the method of claim 30. 

148. A computer readable medium comprising instructions 
15 for performing the method of claim 42. 



20 
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30 
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